![Page 1: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/1.jpg)
EnergyEfficientHPCWorkingGroup
NatalieBates8thAnnualWorkshop
![Page 2: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/2.jpg)
AGENDA:• Teamreports–• EEHPCWGNextStepsandDirecEon–Wheretonext• SCPrimer–whatelsetodo…BoF,Panels• IndustryLinks,AcEviEes,andCollaboraEon
– ASHRAETC9.9,TheGreenGrid,Top500,Green500,PRACE
OBJECTIVE:• EncourageparEcipaEoninEEHPCWG
![Page 3: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/3.jpg)
TEAMREPORTS:• DavidGrant,OakRidgeNaEonalLaboratory• DaleSartor,LawrenceBerkeleyNaEonalLaboratory• DavidMarEnez,SandiaNaEonalLaboratory• AnnaMariaBaily,LawrenceLivermoreNaEonalLaboratory• MichaelPaXerson,IntelCorporaEon• SuzanneRivoire,SonomaStateUniversity• TorstenWilde,LeibnizSupercompuEngCenter• KevinPedre[,SandiaNaEonalLaboratory• SteveMarEn,CrayInc.
![Page 4: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/4.jpg)
• Impactsofthework• Increaseeaseofdeploymentforliquidcoolingcontrols• Improveenergyefficiencyofthecoolingsystemandreducecostsofcooling
• Deliverables• “EEHPCWGLiquidCoolingControlsTeamWhitepaper”;hXps://eehpcwg.llnl.gov/pages/infra_ctrls.htm;2017.• StateofthepracEcecasestudiesforliquidcoolingcontrolsystems
• CurrentacEviEes• DiscussionswithASHRAE,RedfishandPowerAPIonincorporaEngthesedatainputsintheirrecommendaEons
• Nextsteps• InclusionofdatainputsinASHRAE,RedfishandPowerAPI&EEHPCWGProcurementConsideraEonsDocument2017• TotalCostofOwnershipandHPCSystemProcurementBoF;Tuesday12:15• Redfish,PowerAPIandGEOPMBoF;Tuesday17:15
• Helpneeded• AdvocatesforEEHPCWGtoworkonRedfishandPowerAPICommiXees• Contributecasestudiesandlessonslearned
LiquidCoolingControlsDavidGrant,ORNL
![Page 5: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/5.jpg)
– Impactsofthework• Encourageliquid-cooledsoluEonsthatdonotrequirecompressors• Increaseeaseofdeploymentby“standardizing”facilityandHPCequipment• SetthebarformoreopportuniEestoreusewasteheat
– Deliverables• Wxtemperatureclassesdeveloped,presented,andpublished(e.g.SC11),andincludedinASHRAETC9.9Liquid
CoolingGuidelinesforDatacomEquipmentCenters.
– CurrentacEviEes• EEHPCWGmembersprovidinginputandexperEsetodevelop“open”specificaEonforwarmwaterliquid
cooledrackwithmajorinternetcompanies
– Nextsteps• ConEnuetocommunicateandclarifyWxrecommendaEons• ProvideinputtoliquidcooledrackspecificaEonharmonizingU.S.andChinesestandards(e.g.,OCPandScorpio)
– Helpneeded• InputondralspecificaEonsincludingfluidandconnectorsaswellasoperaEngcondiEons(e.g.temperatures
andpressure)
LiquidCooling“Standards”DaleSartor,LBNL
![Page 6: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/6.jpg)
• Impactsofthework• EncouragedecreasedcostsandimproveenergyefficiencywitheffecEveliquidcoolingcommissioning
• Deliverables• “SystemaEcapproachforcommissioningliquidcoolinginfrastructuretosupportliquidcooledHPC
systems”;hXps://eehpcwg.llnl.gov/pages/infra_lccs.htm.2015.• StateofthepracEcecasestudiesforliquidcoolingcommissioning
• CurrentacEviEes• IncluderecommendaEonsinEEHPCWGProcurementConsideraEonsDocument2017
• Nextsteps• TotalCostofOwnershipandHPCSystemProcurementBoF;Tuesday12:15• ASHRAETC9.9toincorporateliquidcoolingcommissioningincommissioningguideline
• Helpneeded• Technicalexpertw/strongtechnicalwriEngskillstofinalizewhitepaperwithASHRAETC9.9CommiXee• Contributecasestudiesandlessonslearned
LiquidCoolingCommissioningDaveMarEnez,SandiaNL
![Page 7: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/7.jpg)
• Impactsofthework• IncreaseenergyandoperaEonalefficiencybyimprovingReliabilityAvailabilityServiceability(RAS)and
MaintainabilitybeyondtheHPCsystemtofacilityinfrastructure• Deliverables
• QuesEonnairecreatedandsenttomajorUSsupercompuEngsites• (4)responsesindicatereliability,availability,serviceability(maintainability)extendsbeyondthesystems
• CurrentacEviEes• SoliciEngfeedbackonteamcreaEonfrommajorUSsupercompuEngsites• DowecreateateamonHPCfacilitymaintainabilityandreliabilityasitrelatestoenergyefficiencyand
availability?• Nextsteps
• WaiEngforresponses• Helpneeded
• CompletethequesEonnaire• SharebestpracEces/lessonslearned
RASandMaintainabilityAnnaMariaBailey,LLNL
![Page 8: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/8.jpg)
• Impactsofthework• CombineswithPUEtoprovideaTOTALviewofwheretheinefficienciesare.Addsa“serverPUE”.Precludes
miscounEngpowerandcoolinglossesonthewrongsideoftheequaEon.• Deliverables
• “TUE,anewenergy-efficiencymetricappliedatORNL'sJaguar”;GaussBestPaperAward;ISC13InternaEonalSupercompuEngConference;Leipzig,Germany;2013.
• StateofthepracEcecasestudiesforTUEandiTUE• RecommendedcapabilityinEEHPCWGProcurementConsideraEonsdocument
• CurrentacEviEes• EvangelizingITUE/TUEintalksandconferences
• Nextsteps• DevelopanITUEcasestudiessessionfornextyearsworkshop
• Helpneeded• EngageTheGreenGridtopromoteiTUEandTUE• ExploreyourabilitytomeasureoresEmateyouriTUEandTUE• Contributecasestudies/lessonslearned
iTUEandTUEMikePaXerson,Intel
![Page 9: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/9.jpg)
• Impactsofthework• ProvidesthefuncEonswhichcanmonitorandrecordpowerconsumpEonofenEresysteminrealEme• MoreaccurateHPCsystemarchitecturaltrenddatafortheHPCCommunity
• Deliverables• StateofthepracEcecasestudiesonpowermeasurementmethodology• “EnergyEfficientHighPerformanceCompuEngPowerMeasurementMethodology(version1.0)”;2012• “Apower-measurementmethodologyforlargescale,highperformancecompuEng”.ACM/SPECInternaEonalConferenceonPerformanceEngineering;2014.• “NodeVariabilityinLarge-ScalePowerMeasurements:PerspecEvesfromtheGreen500,Top500&EEHPCWG”.SC15;2015.• “EnergyEfficientHighPerformanceCompuEngPowerMeasurementMethodology(version2.0RC1.0)”;
hXps://www.top500.org/green500/resources/eehpc-wg-power-measurement-methology/;2015.• “SubmissionsOpenforNewlyMergedTOP500andGreen500”;May6,2016;RichBrueckner;InsideHPC.
• CurrentacEviEes• Solicitandunderstandfeedbackonsystem-levelworkloadpowermeasurementmethodology• EncourageL2/L3measurementsubmissionstoGreen500/Top500
• Nextsteps• Top500/Green500ListL2/L3MeasurementfeedbackpresentedatSC17Green500BoF,Wednesday17:15
• Helpneeded• MakeL2/L3measurementsubmissionstoTop500/Green500List• EncourageextensionofL2/L3measurementsubmissionstootherbenchmarks,e.g.,GreenGraph500
PowerMeasurementMethodologySuzanneRivoire,SonomaState
![Page 10: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/10.jpg)
• Impactsofthework• RaisingawarenessofevolvingrelaEonshipbetweenSCsandtheirElectricityServiceProviders– Thelandscapeischanging-gettoknowyourESPandtheirpartners.– ImplementconEngencyplanningforpowermanagementwhileminimizingimpacttousers.
• Deliverables• "TheElectricalGridandSupercompuEngCenters:AnInvesEgaEveAnalysisofEmergingOpportuniEesandChallenges”;
EnergiinformaEk;Zurich,Switerland;2014.• "SupercompuEngCentersandElectricityServiceProviders:AGeographicallyDistributedPerspecEveonDemandManagement
inEuropeandtheUnitedStates”;ISC16InternaEonalSupercompuEngConference;Frankfurt,Germany;2016.
• CurrentacEviEes• WriEngapaperthatexamineselectricityservicecontractsinmajorSupercompuEngCenters(SC)
• Nextsteps• Finalizeandpublishnextpaper
• Helpneeded• Contributecasestudies/lessonslearned
ElectricGridIntegraEonTorstenWilde,LRZ
![Page 11: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/11.jpg)
• Impactsofthework• SharebestpracEcesofEnergyandPowerAwareJobSchedulingandResourceManagement(EPAJSRM)and
learnfromeachother• IdenEfyopportuniEesforinfluencingproductdevelopment
• Deliverables• Interviewresultsfrom9sitesthathavedeployedoraredoingtechnologydevelopment(TD)withtheintent
todeploylargescaleEPAJSRMcapabilityinaproducEonenvironment• CurrentacEviEes
• AnalyzingdatafromsurveyoflargescaleEPAJSRMdeployments• Nextsteps
• EPAJSRMPoster,EPAJSRMBoF;Wednesday12:15,SolwareandEnergyEfficiencyPanel;Friday10:30.• Whitepaper• Technicalpaper
• Helpneeded• JointheteamandhelpwithdatacollecEon,analysisandwriEngthepaper• IdenEfyotherpotenEalsiteswithlargescaleEPAJSRMinproducEonofTDwithanintenttodeploy
EPAJSRMKevinPedre[,SandiaNL
![Page 12: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/12.jpg)
• Impactsofthework• InfluenceproductdevelopmenttodriveenergyefficientHPCsystems
• Deliverables• StateofthepracEcecasestudiesforenergyefficiencyconsideraEonsinprocurement• ComponentandSystemIntegratorresponsestoEEHPCWGProcurementConsideraEons• EnergyEfficiencyConsideraEonsforHPCProcurementDocuments:2014andEnergyEfficiencyConsideraEonsforHPC
ProcurementDocuments:2013hXps://eehpcwg.llnl.gov/pages/compsys_pro.htm• CurrentacEviEes
• UpdaEngprocurementconsideraEonsdocumentfor2017withveXedmaterial(e.g.,liquidcoolingcontrols)• CollaboraEngwithPRACE(PartnershipforAdvancedCompuEnginEurope)onTCOandProcurement
• Nextsteps• PublishEnergyEfficiencyConsideraEonsforHPCProcurementDocuments:2017• StartworkingonEnergyEfficiencyConsideraEonsforHPCProcurementDocuments:2018• TotalCostofOwnershipandHPCSystemProcurementBoF;Tuesday12:15
• Helpneeded• ParEcipateontheProcurementConsideraEonsTeamandhelpwritedocuments• SharebestpracEceprocurementdocuments
ProcurementConsideraEonsSteveMarEn,CrayInc.
![Page 13: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/13.jpg)
• Impactsofthework• StriveforconsensusonHPCcenterdashboardenergyefficiencyelementsandmetrics
• Deliverables• "Re-examiningHPCEnergyEfficiencyDashboardElements”;12thWorkshoponHighPerformance
PowerAwareCompuEng• “GeneralRecommendaEonsforHighPerformanceCompuEngDataCenterEnergyManagement
DashboardDisplay”;9thWorkshoponHigh-PerformancePower-AwareCompuEngConference
• CurrentacEviEes• QuesEonnaire-currentuseofdashboardsatmajorsupercompuEngcentersinUSA,Europe&Japan
• Nextsteps• AnalyzequesEonnaireresultsandwrite/publishpaper
• Helpneeded• ParEcipateintheDashboardTeamandhelpwithanalyzingdataandwriEngpaper
DashboardsNatalieBates,EEHPCWG
![Page 14: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/14.jpg)
• PotenEalNewTeams• Maintainability• PowerAPI• Warmwatercooling–rackstandard• FacilityHighVoltageandDirectCurrent• EnergyRe-use• OtherSolwareTeams
• ExpandpresencefromUSandEuropetoJapan
EEHPCWGNextStepsandDirecEon–Wheretonext?
![Page 15: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/15.jpg)
IndustryLinksandCollaboraEons
![Page 16: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/16.jpg)
LinkstorelevantBoFDocuments
SC17EEHPCWGPrimer
![Page 17: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/17.jpg)
• WorkshopLunch– LiquidCooling– Maintainability– SWandEnergyEfficiency– SystemPowerMeasurement
• Booth#286– LiquidCooling:TuesdayandWednesday10:30amtoNoon– ReliabilityAvailabilityServiceabilityandMaintainability:Tuesday2:00pm-4:00pm– SolwareandEnergyEfficiency:Wednesday11:00amtoNoon,3:00pm–4:00pm
DiscussionGroups
![Page 18: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/18.jpg)
Wevalueyourfeedback!
hXps://www.surveymonkey.com/r/Y9F3MCN
![Page 19: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/19.jpg)
Thank you!!h"p://[email protected]
![Page 20: Energy Efficient HPC Working Group · learn from each other • IdenEfy opportuniEes for influencing product development ... • "Re-examining HPC Energy Efficiency Dashboard Elements”;](https://reader034.vdocuments.net/reader034/viewer/2022051923/60107e17148f0a219567a9a2/html5/thumbnails/20.jpg)