ams ix data centre standard

8/9/2019 AMS IX Data Centre Standard

1/18

A data centre Standard for theAmsterdam Internet Exchange

A Standard defining the minimum acceptable, and also the desirable levels, of technicalimplementation, resilience of operation and business continuity management for data

centres providing services to the Amsterdam Internet Exchange

Westeinde12

NL1017ZNAmsterdam

Netherlands

www.amsix.net


2/18

Amendment record

1 Draft 12-3-09 BJE

2 First issue 2-4-09 BJE

3 Second issue 6-5-09 BJE

4 Third issue 15-5-09 BJE5 Fourth issue 19-5-09 BJE

6 Fifth issue 19-10-09 BJE

TableofContents

Contents

1 Introduction........................................................................................................................ 3

2 MinimalexpectationsofAMSIX ........................................................................................ 5

3

Technicaldesign

and

implementation ............................................................................... 6

4 OperationalRequirements ............................................................................................... 13

5 BusinessContinuityrequirements ................................................................................... 14

References ............................................................................................................................... 16

Bibliography ............................................................................................................................. 16

Prepared by

B J Elliott BSc, MBA, C.Eng, MIET, MCIBSE

Capitoline LLP 2009

Capitoline LLPCapitoline House7 King Charles TerraceSovereign CloseLondon E1W 3HL

www.capitoline.eu

Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX

AMS-09-001 Issue 005 19-10-09 BJE Page 2 of 18


3/18

1 Introduction

Thesuccessfulandreliableprovisionofdatacentreservicesdependsuponthefollowing;

AwelldesignedandconstructedplantthattakesintoaccountappropriateStandardsandbest

practiceto

achieve

efficient

and

reliable

operation

Managementtechniquesthatputintoplaceoperatingproceduresandprotocolsthatensure

thecontinuingefficientandreliableoperationofthedatacentre

Disasterrecoveryplansthathaveanestablishedandrehearsedprocedurefordealingwithany

incident that impairs the operation of the data centre and puts in to place a recovery

programme

TechnicalStandards

TechnicalStandardsgivethebestpracticemethodsfordesigningandimplementingthedatacentre

fromaphysical,

electrical

and

mechanical

viewpoint.

Some

requirements

covering

health

and

safety

and energy management are covered by European Directives and national standards. Many

technical standards exist that cover the myriad of engineering disciplines encountered in a data

centrebuttwodocuments inparticularaddresstheengineeringaspectsofdatacentredesignand

subsequentresilienceandredundancyofthatdesign;theseare:

ANSI/TIA942:2005TelecommunicationsInfrastructureStandardsforDataCenters

and

TierClassificationsdefinesiteinfrastructureperformance.TheUpTimeInstitute,2008

TheUpTimeInstitutes(TUI)documentdefinesfourTiersofoperationthatdescribetheexpected

downtimeperyearfromadatacentrewhencertaindesignroutesaretaken.TheTIA942standard

draws heavily upon the philosophy offered in the TUI document and offers more detail in

engineeringtermsaboutwhatisrequiredtoachievetheselevels.

Onecentralplankofthephilosophy istheadoptionoftheN,N+1and2Nmethodology.Briefly,N

means enough items to do thejob at hand, N+1 means that each system has one redundant

componentand2Nmeansthatsystemsarecompletelyreplicated.Othervariantsmaybe2N+1for

example, meaning two independentsystemswhereeach systemalsohas redundantcomponents.

Ultimatelyitisariskversuscoststrategyasmorelevelsofredundancyandresiliencewillinvariably

costmore.

Organisations

are

invited

to

consider

the

costs

of

downtime

to

their

own

business

before

theydecideuponthestrategymostappropriatetotheirbusiness.

BothoftheabovestandardsareAmerican.TherearenodirectlyequivalentEuropean(CENELEC)or

international standards (ISO/IEC). The methods described in the two American documents are

mostly universal but for use in Europe the technical references contained in TIA 942 need to be

substitutedforEUDirectivesandCENELECstandardswherevernecessary.

ThehierarchyandorderofprecedenceofstandardsfortheNetherlandsis

Laws,RegulationsandStatutoryInstrumentsofTheNetherlands

Directivesof

the

European

Union

Dutchnationalstandards




4/18

CENELECstandards

ISO/IECstandards

Otherrelevantnationalstandards,e.g.ANSI,TIA,BSI,VDE

Industrybestpractice

BusinessContinuity

standards

Buildingadatacentretothelateststandardsandincorporatingtherequisiteavailability/redundancy

techniques isonlythefirststeptosuccessful longtermoperation. Thenextstage ismanagingthe

datacentreandbeingpreparedfortechnicalfailuresoranyothereventthatimpingesuponthedata

centreoperation.ThisareagenerallycomesundertheheadingofBusinessContinuityManagement,

BCM. BCMstandardscanbegenerallyaimedatallbusinessesandenterpriseswhereassomeare

morefocussedonInformationandCommunicationsTechnology,ICT.

ThefollowingStandardshavebeenidentifiedwhichcoverthisarea.

BS7799

3:2006

Information

security

management

systems.

Guidelines

for

information

securityriskmanagement

BSISO/IEC200001:2005Informationtechnology.Servicemanagement.Specification

BS ISO/IEC 27001:2005 Information technology. Security techniques. Information security

managementsystems.Requirements

BS ISO/IEC 27002:2005, Information technology. Security techniques.Code ofpracticefor

informationsecuritymanagement

BS25999

1:2006

Business

continuity

management,

Part

1:

Code

of

practice

BS25777:2008InformationandCommunicationsTechnologyContinuitymanagement,

CodeofPractice

BSISO/IEC17799:2005Codeofpracticeforinformationsecuritymanagement

ISO/PAS22399:2007SocietalsecurityGuidelinefor incidentpreparednessandoperational

continuitymanagement

NFPA 1600;2007 Standard on Disaster/Emergency Management and Business Continuity

Programs

InadditionwehaveITIL.ITILconsistsofaseriesofbooksgivingguidanceontheprovisionofquality

ITservices,andontheaccommodationandenvironmental facilitiesneededtosupport IT. ITILhas

been developed in recognition of organisations' growing dependency on IT and embodies best

practicesforITServiceManagement.

WealsohavePRINCE.PRINCE2isageneric,simpletofollowprojectmanagementmethod.Itcovers

howtoorganise,manageandcontrolprojects.Itisaimedatenablingyoutosuccessfullydeliverthe

rightproducts,ontimeandwithinbudget.AProjectmanagercanapplytheprinciplesofPRINCE2

and the associated training to any typeofproject. It will help to manage risk, controlqualityand

changeeffectively.




5/18

APRINCE2projecthasthefollowingcharacteristics:

Afiniteanddefinedlifecycle

Definedandmeasurablebusinessproducts

Acorresponding

set

of

activities

to

achieve

the

business

products

Adefinedamountofresources

Anorganisationstructure,withdefinedresponsibilities,tomanagetheproject.

InasurveybyContinuityCentralmagazineofdatacentremanagers inNorthAmericaandEurope,

BS 25999:2006 was the most widely used. In 2008 a companion standard was published, BS

25777:2008 Information and Communications Technology Continuity management, Code of

Practice. It is the opinion of Capitoline LLP that, at the time of writing, BS 25777 is the most

appropriatedocumentforuse inEuropetodescribebestpracticebusinesscontinuitymanagement

intheICTenvironment.

2 Minimal expectations ofAMS IX

2.1 Availability:

Maximumnumberofincidents;

1outagein5years,maximumdowntimeoftwohours

MeanTimeBetweenfailuresofnotlessthanfiveyears

2.2 Environmentalconditionsfornetworkequipment

Thetemperature

and

humidity

of

the

computer

room

must

remain

within

the

limits

set

by

ASHRAE

EnvironmentalGuidelinesforDatacomEquipment:2008.ThisismorefullyexplainedinSection3.6

2.3 Firesuppression:

Thefacilitymustbeprotectedbyahighsensitivityautomaticsmokedetectionsystemcoupledwith

anautomaticgaseoussuppressionsystem.

2.4 Maintenanceregime:

Maintenanceoncriticalitemsmusttakeplaceatagreedtimes

Maintenancewindows

will

be

00h00

07h00

(GMT

+1h)

Maintenancewillbeannouncedtostakeholdersinadvance

Therewillbenoroutinemaintenanceworkoncriticalitemsoutsideofthesetimewindows

2.5 Incidentmanagement

Incidentsmustbemanagedinawaythatallowsadequateresponseandanalysis

Outageannouncedwithin5mintoAMSIXNetworkOperationsCentre,NOC

Outageannouncementstobemadethroughindependentsystemthatareindependentfrom

powerequipmentproductionenvironment

2.6

Personnel




6/18

Onlyqualifiedpersonnelusedformaintenance

Communicateescalationprocedures&contactinformation

RegularlyinformAMSIXonupdateescalationcontactinformation

EfficientsiteaccessforauthorisedAMSIXstaff

Therequirementswillbemetthroughthreeareas;

Thetechnicaldesignandinstallationofthedatacentre

Themanagementandmaintenanceprocedurestooperatethedatacentre

Abusinesscontinuityanddisastermanagementprogramme

TheMinimumRequirementsofAMSIXshallbeprovenbyanauditofthedatacentrefacility

by an external qualified auditor acceptable to both AMSIX and the operator of the data

centre

3

Technicaldesign

and

implementation

3.1 Location

Minimumrequirements

3.1.1 Thebuildingmustbeinanareawithfloodprotection

3.1.2 The building should be no closer than 0.10 km from a railroad or major interstate

highway

3.1.3 Thebuildingmustbeatleast500mfromaradartransmitter

3.1.4 Thebuildingmustbeatleast100mfromamobiletelephonemast

3.1.5

Thebuilding

must

be

at

least

100m

from

any

source

of

electrical

interference

3.1.6 Thebuildingmusthaveadequateaccessbyroadandnearbyparkingfacilities

3.2 Architecturalandbuildingrequirements

Minimumrequirements

3.2.1 Anycomputerroomwindowsfacingeast,westorsouthmustbecoveredtopreventthermalsolargain.

3.2.2 Computerroomnottobelocatedbelowplumbedareassuchasrestrooms,janitor

closets,kitchens,

laboratories

and

mechanical

rooms

unless

aflood

containment

systemhasbeenputinplace.

3.2.3 Thebuildingmusthaveadedicatedloadingareatohandle allanticipateddeliveriesofsuppliesandequipment.

3.2.4 Thebuildingmaterialsmustbenoncombustible e.g.brick,concrete,plasterboardetc.

3.2.5 Thecomputerroomheightmustallow0.4mabovetheequipmentrackonasolidfloorand0.4maboveandbelowarackforaraisedfloor

3.2.6 Allfloorsmustbecapableofsupporting750kgequipmentracks

3.2.7 Ifaraisedfloorisfittedthenitmustbeatleast400mmhighwithairflowsnotsubstantiallyblocked




7/18

3.3 Securityandaccesscontrolrequirements

Minimumrequirements

3.3.1 Anywindowsatgroundfloorlevel,thatallowdirectaccessintothedatacentre,must

be

barred

3.3.2 Securitystaffpershifttobeatleastonepersonper3000m2

ofthedatacentrearea

24hoursperday.

3.3.3 Motiondetectoralarmsincomputerrooms,M&Eplantrooms,telecommunication entranceroomsand,officeareas

3.3.4 Doorsintocomputerroomstobecontrolledbypin,swipecardorbiometricaccess

3.3.5 Maindoorintothedatacentretobecontrolledbypin,swipecardorbiometricaccess

3.3.6 Mannedsecuritycounterwithsigninginandbadgeallocationtovisitors

3.3.7 DigitalCCTVmonitoringandrecordingofallexternaldoorstothecomputerrooms

3.3.8 Nounauthorisedpersonsmustbeabletoenterthecomputerrooms,M&Eplantrooms,telecommunication entranceroomsandofficeareas

3.4 Fireprecautions,smokedetectionandfiresuppression

Minimumrequirements

3.4.1 Numberandlocationoffireexitsaccordingtolocalcodes

3.4.2 Fire exits to be unblocked, opening in the right direction and with 900 mm wideapproachroutes

3.4.3 EmergencylightingtobeinplaceaccordingtolocalcodesorEUDirectives

3.4.4 ExitsignagetobeinplaceaccordingtolocalcodesorEUDirectives

3.4.5 Manualcallpointsmustbefittedaccordingtolocalcodes

3.4.6 Walls and doors to the computer room, telecommunications rooms, M&E plantroomsandothercriticalareastobefireratedtoDutchnationalstandards

3.4.7 Thecomputerroomtobeprotectedbytwocoincident(doubleknock)smokedetectionsystems.Atleastonesystemmustbeanaspiratingsmokedetector(ASD)

monitoringreturnairflows.ThesecondsystemmustbeanotherASDdeviceora

combinationoptical/ionisationdetector

3.4.8 Otherparts of thebuilding must be monitored by anASD or acombination optical/ionisationdetector

3.4.9 Allofthebuildingssmokedetectionsystemsmustbe integrated intoonecommon

alarm

3.4.10

Setting

off

of

the

alarm

must

be

transmitted

to

a

third

party

monitoring

agency

or

the

firebrigade

3.4.11 Amaintenancelogcoveringallitemsrelatedto firedetectionandsuppressionmustbeavailableforinspection

3.4.12 Evidenceofstafftrainingintheeventofafireeventmustbeavailable

3.4.13 Firemarshalswhowilloverseeevacuationofthebuildingandotheragreedactivitiesmustbeidentifiedforeveryshift

3.4.14 Analgorithmshowingthecauseandeffectstatusofallfirerelatedequipment,e.g.HVAC,UPS,firedampers,smokedetection,gasreleaseetc.,mustbeavailablefor

inspectionandapprovalbyAMSIX.

3.4.15 Thecomputerroommustbeprotectedwithagaseousfiresuppressionsystem

3.4.16 ThegasfiresuppressionsystemmustbeanEUapprovedcleanagentwithlowozone

depletionand

global

warming

potential




8/18

3.4.17 Thegasfiresuppressionsystemmustonlybeactivatedbytwoseparateandconcurringfiredetectionsystemsorbymanualactivation.Thesystemmustalso

haveamanualoverride.Thesystemmustbeleftinautomaticmode

3.4.18 Areasprotectedbythegasfiresuppressionsystemmustbefittedwithadequateoverpressureventilationplates

3.4.19 Ameansofpurgingtheareaofgasafteradischargemustbeinplace

3.4.20 ManualfireextinguishersmustbeplacedatdoorwaysorotherrelevantpointscontainingCO2orotherapprovedfiresuppressant.

3.4.21 Allfirerelatedsignagemustbeinplace,e.g.gassuppressionsystemwarningsondoors,actionsintheeventoffirenoticesetc

3.4.22 EveryroomprotectedbyagassuppressionsystemmustbepressuretestedtoISO14520andacertificatetothateffecttobeavailableprovingtheroomhaspassedthe

pressuretestwithinthelast12months

3.4.23 Allfiredetectionandsuppressionsystemsmustbedesignedandinstalledbyqualifiedpersonnelanddesignedtonationalorinternationalstandards,e.g.NFPA75,

BS6266,VdS2095etc

3.4.24 Ifthecomputerroom,telecommunications roomorM&Eplantroomshavea

sprinklersystemthenitmustbeofthepreactiontype

3.4.25 Adjoiningroomsorbuildingstothemaindatacentrelocationshouldbeprotectedwithasprinklersystem.Iftheyarenotthenthefireriskoftheadjoiningbuilding

mustbeassessedandmethodstolimitfirespreaddescribed.

3.5 Provisionofpowersupplies

Minimumrequirements

3.5.1 Thesitemustbefedfroma transformersubstation dedicatedtothedatacentreanditsassociatedfacilities

3.5.2

Transformersmust

be

in

asecured

area

3.5.3 Power cables must enter the building and be terminated in a dedicated electricalswitchroomcontainingallnecessaryswitchingandmetering

3.5.4 Thepoweravailabletothesitefromthemainsutilitymustbeatleast20%morethan

thepeakprojectedload

3.5.5 Atleasttwostandbygenerators,inanN+1configuration, arerequiredtoprovidepowerintheeventofamainsfailure

3.5.6 Thestandbygeneratormustbeavailablewithatleast24hoursoffuel

3.5.7 Ifmorethanonegeneratorisavailablethenanautomaticsynchronizingdevicemustbefittedwithamanualoverrideoperationpossible

3.5.8 Operationofthegeneratorwillbebyanautomatictransferswitchthatwilldetectmainsfailure

3.5.9

Thegenerator

will

automatically

switch

off

when

mains

power

is

restored

3.5.10 Thegeneratorwillhavemanualcontrolsbutwillbeleftsettotheautomaticsettingundernormalcircumstances

3.5.11 Amaintenanceandtestregimewillbeinplaceandthesystemwillhavebeentestedwithaloadbankandthenwithaliveload

3.5.12 Aconnectionwillbemadeavailablesothatanexternalgeneratorcanbepluggedintothemainswitchboard

3.5.13 Thegeneratorandcablingwillbeinasecurelocationadjacentorwithinthedatacentre

3.5.14 Thepowercapacityofthegeneratorwillbe atleast20%morethanthepeakprojectedload

3.5.15

The

ICT

equipment

will

be

protected

by

an

Uninterruptible

Power

Supply,

UPS,

in

an

N+1manner




9/18

3.5.16 TheenergystoragemechanismoftheUPSwillbesufficientthattherewillbeadequatetimeforthestandbygeneratortostartandcomeonline

3.5.17 EachUPSwillhaveitsowndedicatedenergystoragemedium,e.g.batterystring,kineticenergysystemetc.

3.5.18 TheUPSwillbecentralised

3.5.19 ThecapacityoftheUPSwillbegreaterthanthepeakprojectedload.Theaveragerunningloadcapacitywillnotbemorethan80%oftheUPScapability

3.5.20 TheUPSwillhaveasoftwarebasedmonitoring,reportingandalarmsystem

3.5.21 TheUPSwillbecapableofanautomaticandmanualbypassontorawmainsfeedintheeventofmaintenancerequirementsorcompleteUPSfailure

3.5.22 UPSunitconnectedinparallelwillhavebeenfullytestedunderloadandwillbeguaranteedbythemanufacturerforthatconfiguration

3.5.23 TheUPSwilldistributepowertotheICTequipmentviaPowerDistributionUnit(PDU)switchgear

3.5.24 TwopowercableswillbeavailabletoeachracklocationfedfromtwoseparatePDUs

3.5.25 Arackdesignatedasacommunicationsrackwillbeabletobesuppliedwithatleasttwo32ampsinglephasefeeds

3.5.26

Racksrequiring

more

power

will

be

supplied

with

more

32

amp

feeds

but

preferably

withathreephasedistributionsystem

3.5.27 Threephasepowerdistributionsystemsthroughoutthedatacentrewillbeevenlyloadedtowithin5%ofeachotherandthismustbeeasilymeasurableatallsignificant

pointse.g.UPSoutput

3.5.28 TwopowerstripswillbeavailableineachrackeachfedfromaseparatePDU.Eachpowerstripmusthavealocalcurrentmonitoringfacility

3.5.29 Thebuildingwillbeprotectedwithalightningprotectionsystem

3.5.30 Externalplantsuchasgeneratorsandcondenserswillhaveallexternalmetalworkearthedsothatsurgecurrentscannotenterthebuilding

3.5.31 Incomingcoppercommunicationscableswillbeprotectedwithsurgesuppressorsbeforetheyenterthecomputerroom

3.5.32

Thecomputer

room

will

have

an

exposed

copper

main

earth

terminal

that

will

be

the

earthreferencepointfortheroom

3.5.33 Thefollowingitemswillconnectedtotheearthingsystem;allequipmentracks,atleastevery6

thlegofanyfloorpedestalarrangement,allmetalliccablecontainment,

allelectricalswitchgear,HVACunitsandmetallicducting,allmetallicpipes,the

exposedstructuralsteelofthebuilding

3.5.34 Ifpowerislosttoarackorracksthenthesystemmustbeabletorestartautomaticallywithoutcausingcircuitbreakerstotripoutduetohighinrushcurrents.

Thismaybeachievedbyusing'softstart'equipment,automaticsequentialstartup

proceduresorbyhavingsufficientovercapacityinthepowersupplytrain.




10/18

Notethattransferswitches

andsynchronisation

devicesmaybeseenasa

singlepointoffailurebut

theprobabilityoffailureis

regardedassufficientlylow

Figure1

Minimumacceptablepowersupplyarrangement.GenerallyinanN+1format




11/18

3.6 Provisionofcoolingandventilation

Minimumrequirements

3.6.1 ThecomputerroommustmaintaintemperatureandhumiditycontrolaccordingtotheASHRAE2008requirementslistedbelow.Batteryroomsmustbelimitedto25

0C.

The

system

must

maintain

this

capability

at

full

load

and

with

an

external

temperatureof360C

3.6.2 HVACequipmentshallbeconnectedtothemainsinputandbackedupwithastandby

generatorasdescribedinsection3.5

3.6.3 HVACequipmentshallsupplycoolingcapacityinanN+1format

3.6.4 HVACequipmentshallberatedtoatleast20%morecapacitythanthemaximumexpectedsteadystateloadofthecomputerroomevenafteroneCRACunithasfailed

orbeenturnedoff

3.6.5 Humiditycontrolmustbeprovided

3.6.6 Aventilationsystemmustbeinplacetochangetheairinthecomputer,telecomsroom,plantroomatapproximatelyoneairchangeperhour

3.6.7 AllincomingairmustbefilteredaccordingtoEN77960%standard.Smokedetectors

mustbe

fitted

to

the

incoming

air,

after

filtration,

that

will

shut

off

the

air

intakes

if

smokeisdetected

3.6.8 Ameansofpurginggasprotectedroomsmustbeinplaceforremovaloffiresuppressiongasafteradischargeevent

ASHRAE2008computerroomenvironmentalrequirements

Lowendtemperature 180C

Highendtemperature 270C

Lowendmoisture 5.50Cdewpoint(note,thismaybetakenasaminimumRH

of35%

for

simple

measuring)

Highendmoisture 60%RHand150Cdewpoint

Inaddition

Minimumcoldaisletemperature 180C

Maximumcoldaisletemperature 240C

Maximumhotaisletemperature 350C

Ifthereisnodefinedhotaislecoldaislelayoutinplacethenmeasurementswillbetakenattheair

inputandairexhaustsectionsofallappropriateracks.

3.7 ProvisionofCablingandcablemanagement

Minimumrequirements

3.7.1 Astandardsbasedstructuredcablingsystemistobeinplacetoprovideconnectivitytoeveryrack

3.7.2 Allinteriorcablingshallbeofalowflammabilitytype.Anynewcablingmustbespecifiedaslowflammabilityandzerohalogentype

3.7.3 Externalcables,i.e.flammableconstruction,shallnotbetakenmorethan5mintothebuildingbeforetheyareterminatedorenclosedinanonflammableconduit

system




12/18

3.7.4 Everyrackwillhaveaccesstoacablecontainmentsystem,aboveandorbelowit,thatwillallowcablestobeproperlymanagedbetweenracks

3.7.5 Dataandsinglephasepowercableswillbeseparatedbyatleast200mm

3.7.6 Dataandthreephasepowercableswillbeseparatedbyatleast600mm

3.7.7 Nocablewillbetrappedindoors,laidoutonthefloor,strungbetweenracksor

forced

into

right

angle

bends

3.7.8 Everycablewillhaveauniqueidentitylabelatbothendsdenotingorigin,destination

andifnecessary,owner

3.7.9 Everyequipmentrackwillhaveauniqueidentityandifnecessary,ownerslabel

3.7.10 Therewillbeaseparatetelecommunications roomordedicatedcommsareainthe

computerroomforconnectingseparateexternaltelecommunications cablesinputs.

3.7.11 Telecommunications roomsorareas,thatcontainactiveequipment,willprovide;airconditioningandfireprotectiontothesamestandardasthecomputerroom,change

fromexternalgradetointernalgradecable,provideovervoltageprotectiononall

coppercables,provideacleardemarcationbetweenownershipofcablesand

equipment

3.7.12 Allcablespassingthroughfirewallswillbesealedagainstfireandsmoketonational

orEU

regulations

3.7.13 Allmetalliccablecontainmentitemstobecorrectlyearthed

3.7.14 Eachequipmentrackwillprovideadequateverticalandhorizontalcablemanagementitemstopreventpatchcordsfromobscuringanyitemofequipment

3.8 BuildingManagementSystemsandmonitoring

Minimumrequirements

3.8.1 Thecomputerroomwillhaveonegeneraltemperaturesensorandonegeneral

humiditysensor

for

the

room

3.8.2 Telecommunications andplantroomswillhaveageneraltemperatureandhumiditysensor

3.8.3 Therewillbeawatersensorundereveryraisedfloor,everyCRACunitandeverywatercooledrackandalsoineveryplantroom

3.8.4 EverysensorwillbewiredbacktoadedicatedBMSpanelinoneofthetelecommunications rooms

3.8.5 AsoftwarebasedBMSwillmonitoreverytemperature,humidityandwatersensor

thestatusofthefirealarmpanel

thestatusofthesecurity/accesscontrolsystem

thestatusoftheincomingmainsandautomatictransferswitch

the

status

of

the

generators

thestatusofeachUPSandCRACunit

thestatusofanyfire/smokecontrolorHVACdampers

itsownstatus

3.8.6 ThisinformationwillbedisplayedonadedicatedBMSterminalwithgraphicalinterface

3.8.7 TheessentialitemsoftheBMSsystemwillhaveadedicatedUPSsupplywithatleast

onehourofbatterytimeorwithotherpowerbackupmethods.

3.8.8 Amanagementstrategywillbeinplacethatwilldescribethereactiontoeachalarm,whowillrespondandresponseoutsideofnormalworkinghours

3.8.9 Essentialalarmswillconnectviaanexternaltelecommunications circuittoanagreedlistofstakeholders

3.8.10

TheBMS

will

store

historical

trends

and

generate

incident

logs

and

reports




13/18

3.8.11 TheBMSwillbefailsafeinthatifitshouldfailitwillnotaffecttheoperationofanysystemthatitpurelymonitors

4

OperationalRequirements

Management techniques must be put in place that give operating procedures and protocols that

ensurethecontinuingefficientandreliableoperationofthedatacentreandtimelycommunication

toallstakeholders.

4.1 Goodworkpracticesinthebuilding

Minimumrequirements

4.1.1 Thedatacentrewillhaveonecentralmannedpedestrianentranceandonegeneralloadingbayarea

4.1.2 Allequipmentwillbeunpackedandassembledinadedicatedbuildareaandnotinalivecomputerroom

4.1.3 Therewillbeadedicatedcontrol roomorarea.Allcontrolandmonitoringfunctionswillbeconnectedintoanddisplayedinthecontrolroom

4.2 OperationalManagementDocumentationrequired

Minimumrequirements

4.2.1 Ageneraloperationsmanualisrequiredthatbringstogetheralltheoperatingrequirementsandsettingsofthedatacentre

4.2.2 Allmajoritemsofequipment,e.g.UPS,HVAC,generatoretcshallbeincludedinanassetregisterwhichwillincludeasettingsandoperationalproceduretoinclude

Location

Serialnumber

Dataofprocurement

Manufacturer contactdetails

Maintenance/call outcontactdetails

Servicehistory

Datesofcalibrationifrequired

Settingsandsetpointstobeobservede.g.RHandreturntemperatureonCRAC

units

4.2.3 Achecklistisrequiredofallitemsthatneedtobeleftinanautomaticstatusandwherethesecontrolsarelocated,e.g.firecontrolpanelandgassuppressionsystem,

activationofstandbygeneratoretc

4.2.4 Sitedocumentationinformationtoinclude

Buildingandfloorplans

Locationsofracksandothermajoritemsofequipment

Racklayout

Logicalandphysicalinterconnectivity ofequipment

4.2.5

Acall

list

is

to

be

available

which

will

list

all

principle

staff

of

the

data

centre,

their

functionandcontactdetailsplusanyappropriatesuppliers,maintenancecompanies




14/18

andemergencyservices

4.2.6 Thedatacentrewillhaveasafetyoperationsmanualthatwilldetail

Safeworkingatheight

Safeuseofelectricity

Useoflasertransmissionequipment

Liftingheavyloads

Monitoringofnoiseintheworkplace

Useofbarriersaroundworkareassuchasmissingfloortilesetc

4.2.7 Analgorithmchartisrequiredthatwilldetailthecauseandeffectofallrelated

Firedetection

Alarmstates

Activationofgassuppression

Controlofdampers

Poweringoffofpowersupplyequipment

PoweringoffofHVACunits

Restartprocedures

4.2.8 Amethodstatementisrequireddetailinghowvisitorswillbeidentifiedandescorted

aroundthe

site

4.2.9 Amethodstatementisrequireddetailinghowexternalcontractorsmayenterandworkonthesiteandhowtheirworkismonitored,controlledandrecorded

4.2.10 Anaudittrailisrequiredthatdemonstrateshowchangestothedesignandfabricofthedatacentrearemade.ThiscouldbebyaChangeControlDocumentandWork

Ordermethod

4.2.11 Awrittenplanmustbeinplacethatdetailshowallalarmsstatesandsystemfailureswillbehandledbythedatacentrestaff

4.3 Maintenanceprocedures

Minimumrequirements

4.3.1 Anyinternalstaffinvolvedinmaintenancemustbetrainedandqualifiedtodoso.Apersonalstatementmustdemonstratehowthiscompetencehasbeenachievede.g.,

professional/trade qualifications, attendanceatmanufacturers trainingcoursesetc

4.3.2 Anyexternalcontractorinvolvedinmaintenancemustalsobeabletodemonstratecompetence

4.3.3 Allequipmentrequiringmaintenanceshallhaveamaintenancelogdetailingtheequipment,maintenancedates,outcomes,contactdetailsetc.See4.2.2

4.3.4 Maintenanceoncriticalitemsmusttakeplaceatagreedtimes. Thesewillbeduring07h0012h00(GMT+1h).IncidentManagement,i.e.,tobringacomponentbackinto

production after a failure, should be done between 00h00 and 07h00Maintenance

willbe

pre

announced

to

stakeholders

at

least

one

week

in

advance.

There

will

be

no

routinemaintenanceworkoncriticalitemsoutsideofthesetimewindows.

5 Business Continuity requirements

Recoveryplansmustbe inplacethathasanestablishedandrehearsedprocedurefordealingwith

any incident that impairs the operation of the data centre and puts in to place a recovery

programme.




15/18

AnICTcontinuityprogrammemust

Understandthethreatsto,andvulnerabilitiesof,ICTservices

IdentifythepotentialimpactsofdisruptiontoICTservices

Providecollaborationbetweendatacentrestaff,internalandexternalserviceprovidersand

stakeholders

DemonstratecompetencebycredibleresponsesthroughexercisingICTcontinuityplansand

testICTcontinuityarrangements

Thedatacentremustbeableto

ProtecttheICTenvironmentthroughresilientdesignandbestpracticeengineering

Detectincidentsattheearliestopportunity

Reacttoanincidentinanappropriatemanner

Recoverthedataprocessingandcommunicationssystemsinaprioritisedmanner

Operateinadisasterrecoverymodeuntilnormaloperationsarepossible

Returnto

anormal

business

position

5.1 Incidenthandlinganddisasterrecovery

Minimumrequirements

5.1.1 Thedatacentremusthaveariskassessmentanalysisthatdetailsrisks,theimpactof

theseriskandthestrategytoobviatetheserisks,e.g.

Site:fire,

flooding

Operations:powersupplyfailure

Personnel:majorepidemicetc

Communications: maincabledamage

5.1.2 AllcriticalsystemssuchasUPSstatus,fireconditionsetc,mustbeautomaticallymonitored.Thesearedetailedinsection3.8

5.1.3 AnycriticalfailureorlossofservicemustbecommunicatedtoAMSIXbytelephonewithinfiveminutes

5.1.4 Anycriticalfailureorlossofservicemustbeautomaticallycommunicatedtoallrelevantpersonnel,managementandotherstakeholderswithinfiveminutes

5.1.5 Themethodofcommunicationtoexternalagenciesandstakeholdersmustbe

independentofthesamecriticalfacilitiesthathavefailede.g.essentialmonitoring

andcommunications

equipment

must

be

powered

by

an

independent

battery

backed

supply

5.1.6 Awrittenplanmustbeinplacethatdetailshowallalarmsstatesandsystemfailureswillbehandledbythedatacentrestaff

5.1.7 Allmajorincidentswillbesubjecttoamanagementreviewthatwilldetail

Whattheincidentwas

Whereithappened

Whenithappened

Whatwastheimpactonserviceprovision

Howwasitdealtwith

Whatchangescanbemadetopreventasimilarincidenthappeningagain

5.1.8 Astatementisrequiredthatwilldetailtheimpactofasuddenandcompletelossof

poweron

the

ICT

equipment

and

how

arestart

will

be

managed




16/18

5.1.9 Acalllististobeavailablewhichwilllistallprinciplestaffofthedatacentre,theirfunctionandcontactdetailsplusanyappropriatesuppliers,maintenancecompanies

andemergencyservices.Contactdetailsmustalsoincludeoutofhourscontact

detailsanddefineresponsibilities ofalltheparties.

5.1.10 TheeffectsofpowercutsmustbesimulatedtoprovetheoperationofUPSandgeneratorstartuproutines.Thesesimulationsmustbetreatedasmaintenance

episodesand

take

place

and

be

communicated

as

4.3.3

References

ANSI/TIA942:2005TelecommunicationsInfrastructureStandardsforDataCenters

ASHRAE2008computerroomenvironmentalrequirements

TierClassificationsdefinesiteinfrastructureperformance.TheUpTimeInstitute,2008

BS6266:2002

Code

of

practice

for

fire

protection

for

electronic

equipment

installations

EN 779:2002 Particulate air filters for general ventilation. Determination of the filtration

performance

EN501735:Informationtechnology:GenericCablingforDataCentres

ISO 145201:2006 Gaseous fireextinguishing systems. Physical properties and system design.

Generalrequirements

NFPA75:StandardfortheProtectionofInformationTechnologyEquipment,2009Edition

VdS2095:200502VdSguidelinesforautomaticfiredetectionandfirealarmsystemsPlanningand

installation

Bibl iography

Accessforthedisabled

Council Directive 2000/78/EC of 27 November 2000 establishing a general framework for equal

treatmentinemploymentandoccupation

BS8300:2008DesignofbuildingsandtheirapproachestomeettheneedsofdisabledpeopleCode

ofpractice

BusinessContinuity

BS77993:2006Informationsecuritymanagementsystems.Guidelinesfor informationsecurityrisk

management

BSISO/IEC200001:2005Informationtechnology.Servicemanagement.Specification

BS ISO/IEC 27001:2005 Information technology. Security techniques. Information security

managementsystems.Requirements

BS ISO/IEC 27002:2005, Information technology. Security techniques. Code of practice for

informationsecuritymanagement

BS259991:2006Businesscontinuitymanagement,Part1:Codeofpractice

BS25777:2008InformationandCommunicationsTechnologyContinuitymanagement,Codeof

Practice




17/18

BSISO/IEC17799:2005Codeofpracticeforinformationsecuritymanagement

ISO/PAS 22399:2007 Societal security Guideline for incident preparedness and operational

continuitymanagement

NFPA1600;2007StandardonDisaster/EmergencyManagementandBusinessContinuityPrograms

Designsto

minimize

fire

risk

BritishBuildingRegulations:2000PartB,Firestopping

TheConstructionProductsDirective(CouncilDirective89/106/EEC)

BS58396:2004Firedetectionandfirealarmsystemsforbuildings.Codeofpracticeforthedesign,

installationandmaintenanceoffiredetectionandfirealarmsystemsindwellings

BS6266:2002Codeofpracticeforfireprotectionforelectronicequipmentinstallations

ISO 145201:2006 Gaseous fireextinguishing systems. Physical properties and system design.

Generalrequirements

BS72731:2006Codeofpracticefortheoperationoffireprotectionmeasures.Electricalactuation

ofgaseoustotalfloodingextinguishingsystems

EN54

20:2006

Fire

detection

and

fire

alarm

systems.

Aspirating

smoke

detectors

EN 779:2002 Particulate air filters for general ventilation. Determination of the filtration

performance

BFPSACodeofPracticeforDesign,Installation,Commissioning&MaintenanceofAspiratingSmoke

Detector(ASD)Systems2005

BFPSAGuidanceonECRegulationNo842/2006onCertainFluorinated

GreenhouseGases2006

Regulation (EC) No 842/2006 of the European Parliament and of the Council of 17 May 2006 on

certainfluorinatedgreenhousegases

NFPA72:NATIONALFIREALARMCODE:2007

NFPA75:StandardfortheProtectionofInformationTechnologyEquipment,2009Edition

ElectricalSafety

BS7671(IEE17thEdition)RequirementsForElectricalInstallations

BS6701TelecommunicationsEquipmentandcabling

EN50310Bonding&EarthinginBuildingsWithITequipment

EN609501:2002,InformationtechnologyequipmentSafety~Generalrequirements

NEN1010:2007Dnormvoorlaagspanningsinstallaties

EmergencyLightingandsignage

BS5266

:Part

1:1999

Code

of

Practice

for

Emergency

Lighting

BS 54995:2002 Graphical symbols and signs ~ Safetysigns, including fire safety signs Signs with

specificsafetymeanings

StatutoryInstrument2005No.1541TheRegulatoryReform(FireSafety)Order2005

Energyconsumptionandoptimisation

EUEnergyperformanceofBuildingsDirective2002/91/EC

EUEnergyServicesDirective2006/32/EC

Energy savings at Data Hotels, The Environmental and building department of the Municipality of

Amsterdam,ECN,April2008




18/18



EU Code of Conduct on Data Centres Energy Efficiency Version 1.0 EUROPEAN COMMISSION

DIRECTORATEGENERALJRCJOINTRESEARCHCENTREInstituteforEnergyRenewableEnergiesUnit,

October2008

Healthandsafety

TheConstruction(DesignandManagement)Regulations2007

Workplace(Health,SafetyandWelfare)Regulations1992

ANSIZ136.2SafeUseofLasers inOpticalFiberCommunicationSystemsUtilizingLaserDiodeand

LEDSources

IEC608252.SafetyofLaserProductsPart2:Safetyofopticalfibrecommunicationsystems(OFCS).

HVAC

ASHRAEThermalGuidelinesforDataProcessingEnvironments2004

CIBSEGuideB.Heating,ventilation,airconditioningandrefrigeration

TheBuilding

Regulations

Approved

Document

F

VentilationTIA942TelecommunicationsInfrastructureStandardforDataCenters

VDI2054Airconditioningforcomputerareas

RaisedAccessFloors

EN12825:2001Raisedaccessfloors

Property Services Agency (PSA) Method of Building Performance Specification 'Platform Floors

(RaisedAccessFloors)',MOBPF2PS

RIBANBSK41Raisedaccessfloors

System

Design

EN501732:ITGenericITCablingForCustomersPremises

EN501723:ITGenericCablingforIndustrialPremises

EN501734:ITGenericCablingforHomes

EN501735:ITGenericCablingforDataCentres

ISO11801:2001ITGenericCabling

TIA942TelecommunicationsInfrastructureStandardforDataCenters

SystemInstallationandqualityassurance

EN

50174

1

(2000)

Information

technology

cabling

installation

Part

1:

Specification

and

quality

assurance

EN501742(2000)InformationtechnologyCabling installationPart2:Installationandplanning

practicesinsidebuildings,

ISO/IECTR147632InformationtechnologyImplementationandoperationofcustomerpremises

part2:Planningandinstallation

SystemTest

EN50346:2002InformationtechnologyCablinginstallationTestingofinstalledcabling

IEC619351 Generic cabling systemsSpecificationfor the testingofbalancedcommunication

cablinginaccordancewithISO/IEC11801Part1:Installedcabling

ams ix data centre standard

Documents