Yu. Guz 2015/04/21 1

CALO HV

Updated version of the 2012 slides, http://indico.cern.ch/event/181183/contribution/6/material/slides/0.pptx

** See also Anatoli’s slides for the 2009 piquet training **http://indico.cern.ch/event/70825/contribution/3/material/slides/0.ppt

Yu. Guz 2015/04/21 2

xCAL HV system hardware (x{E,H})PMT/CWs

Each xCAL PMT installed on the detector wall is equipped with an individual Cockcroft-Walton (CW) HV generator. Each requires DC power (+6V, -6V and +90V), and a control voltage determining the HV value.These voltages are provided by HV/LED control boxes installed below and above the calorimeters

HCAL ECAL

Yu. Guz 2015/04/21 3

xCAL HV system hardware: control boxes

Total of 40 control and distribution boxes are installed at the chariots and at the CALO platform: 32 ECAL, 8 HCAL

They provide:• DC power and control voltages for the xCAL CW generators;• DC power and control voltages for LED drivers (NB decoupled from common ground)• bias voltage for PIN photodiodes and DC power for their amplifiers

The output voltages are controlled: • control voltages for CWs – SPECS DCU• voltage at +6V and -6V CW power lines – SPECS DCU• control voltage for LEDs – dedicated ADC

LV&MV in CW control

CW power

LED/PINpower,LED control

SPECS

Inputs: • +6V, +7V, -7V, 15V : DCS LV, from MARATONs (platform)• +90V, -25V : DCS MV, from Agilent PS (D3)• SPECS communication inputOutputs:• 8 power lines for xCAL CW (up to 40 CWs on each line)• DAC control of up to 200 xCAL CW bases• 8 outputs with LED/PIN power + 2 LED control each• SPECS output

Output protection on the CW DC power outputs: • +6V -6V : fuses• +90V : relays

Yu. Guz 2015/04/21 4

SPECS RJ4511 slots

3 slots

10 LED control signals

In Power 150 V +- 7 V

Out Power

DC voltages

and Trigger signals Level

Converters for LED Drivers

20 wires flat cable

10 channels CW converter board HV_LED_DAC board

Control & Monitoring Bus

6 slotsSPECS RJ45

11 slots

3 slots

10 LED control signals

In Power 150 V +- 7 V

Out Power

DC voltages

and Trigger signals Level

Converters for LED Drivers

20 wires flat cable

10 channels CW converter board HV_LED_DAC board

Control & Monitoring Bus

6 slots

6 7 1098 1211 16151413

PS SPD

0 4 5321

SP

AR

E

48 LVDSFrom LEDTSB

PS / SPD HV system hardware

The PS/SPD MAPMT modules use HV produced by CW generators installed at the CALO platform.

The HV system is arranged in two crates (one per side, in racks L3B03 and L3B13). Each crate contains: 1 DAC module, 11 CW modules (5 PS, 5 SPD, 1 spare); LED control board. Each CW module contains 10 CW generator mezzanines and serves 10 MAPMTs.

Inputs: • +7V, -7V : DCS LV, from MARATONs (platform)• +150V : DCS MV, from Agilent PS (D3)• SPECS communication Outputs:• 110 HV outputs for MAPMTs• 10 DAC outputs for LED control

DAC module

CW modulesLED control

Yu. Guz 2015/04/21 5

Rack D3B04 in D34 Agilent power supplies for HCAL, ECAL, PRSA and PRSC (+ one power supply +5V for the CALO Status Bit board, not discussed here).

MV hardware The MV necessary for the CALO HV is provided by Agilent power supplies (PS1—PS4): • HCAL, ECAL: two N6701 power frames, each with 2 N6776 (100V ) and 2 N6734B (30V) units, produce +90 V for CW bases (1 per side) and -25 V for PIN photodiode bias (1 per side)• PS/SPD : two 1-channel N5750A power supplies producing +150 V for CWs (1 per side).

Ch 1 Ch 2 Ch 3 Ch 4PS1 hcagil01 +90V HCAL A -25V HCAL A +90V HCAL C -25V HCAL CPS2 ecagil01 +90V ECAL A -25V ECAL A +90V ECAL C -25V ECAL CPS3 psagil01 +150V PRS APS4 psagil02 +150V PRS C

Served by the CADCSMV project running on CADCS01.The PVSS control is based on standard MARATON software; the Agilent commands and readings are relayed into MARATON datapoints via DIM. Each Agilent box is served by an individual communication executable installed as a service on a CCPC named CACC0601W (this CCPC also hosts the CALO MARATON communication for CADCSLV; its name can be found and status can be checked in the “Fieldbus status” panel available from BigBrother)

One service per PS

HCAL

PRS C

PRS A

ECAL

The LV control: see Patrick’s slides

Yu. Guz 2015/04/21 6

MV ECS control

Use shortcut: /group/online/ecs/Shortcuts311/CALO/CADCSMV/CADCSMV_UI_DEN.shFew things to remember:• switch MV ON/OFF only at the HV OFF state, for the sake of safety;• the MV is ramped up rather slowly, ~3 min for HCAL and up to 5 min for ECAL and PRS. During the ramp, the Agilent DIM applications are not responding and FSM state does not change. Be patient. Only larger time interval may indicate problems. • the protection state of a power supply channel (overcurrent, overvoltage etc) leads to the FSM ERROR state. The RECOVER FSM command or OFF button of the device panel switches off this particular channel and resets its protection (no need to reset the whole power supply).

The LV control: see Patrick’s slides

Yu. Guz 2015/04/21 7

ECS HV control Control PC PVSS projectPRS C PSDAQHVC01 PRSHVC1PRS A PSDAQHVA01 PRSHVA1ECAL C ECHVC01 HCHVC1ECAL A ECHVA01 HCHVA1HCAL C HCDAQHVC01 ECHVC1HCAL A HCDAQHVA01 ECHVA1

Six separate PVSS projects on six control PCs. They are included into the LHCb FSM hierarchy, so that the HVs are controlled centrally. On top of it, many tools are available for piquet / expert operations:• manipulations with recipes: prepare, store, delete• switching ON/OFF/masking individual channels, modification of their parameters• modify DAC box parameters , exclude or include it into the FSM hierarchy

Three main FSM states are used: OFF, STANDBY1, READY. Corresponding FSM commands are Go_OFF, Go_STANDBY1 and Go_READY.

Yu. Guz 2015/04/21 8

ECS HV controlAll the six projects have similar structure. The FSM / central operation is based on a permanently running worker script (“monitoring”) which:

• at a period of ~ 20 sec, reads out all the DAC values, voltages measured at the LV DC power lines, status of the relays at the MV lines;

• in case of unexpected readings, it produces alarms at the alarm screen or device ERROR state

• upon arrival of an FSM command, it ramps the device to the desired state

restart it

Control managerrunning the monitoring script

The monitoring script sends a short report to the log screen after every readout cycle. Absence of such reports mean that the monitoring task is stuck. This typically happens at a project restart at LV not in READY state. In this case, the corresponding PVSS manager is to be restarted.

In every case of strange behavior of a CALO HV project, it can be useful first to check the status of its monitoring manager, and restart it if needed

It can also be restarted from the FSM HV panel (next slides) and from CALO fwSystemOverview panel (/group/online/ecs/Shortcuts311/CALO/CALO_UI_fwSystemOverview.sh).

Yu. Guz 2015/04/21 9

ECS HV control: xCAL

UMV, IMV

current recipe name

Opens “connectivity” panel

save a recipe (double click)

The project panel. A lot of piquet / expert functionality. Useful for piquet:

• MV voltage and current display

• HV AutoUpdate control (ON/OFF) and status display

• manipulation with recipes: displays current recipe and full list of existing recipes; allows saving current datapoint values into a recipe

• open connectivity panel, displaying connectivity and settings of individual channels

• expert operations, for preparation of HV/LED recipes

(*) The HV AutoUpdate is intended to update the PHYSICS HV recipes after each fill according to prescriptions from automatic Occupancy/LED analysis

(**) it is not fully implemented yet

(***) It is going to be implemented in the monitoring scripts of each of the 4 ECAL / HCAL projects.

delete a recipe (double click)

opens “expert operation” panel (double click)

Yu. Guz 2015/04/21 10

ECS HV control: connectivity panel

displays connectivity and current settings for a selected cell. The search is possible on:

cell name (“coordinates”, like O_18_08)cell (x,y) coordinates in mmDAC channel (1000*box# + chan#)ADC channel (10000*crateId + 100*slot# + input#) PMT name PIN name, PIN ADC channel, LED DAC channel LEDTSB channel etc ...

NB DAC channel numbers start from 0 here, but from 1 in the DAC box panels!

Expert / piquet operations. The button “restart HVmon” is especially useful for piquet.

The rest is for preparation of HV/LED recipes:

uniform PMT gain uniform LED control voltage HV from/to Calo database LED control voltage from/to Calo databasecustom HVs, LEDs control, channel masks from ascii files

Yu. Guz 2015/04/21 11

ECS HV control: xCAL

UMV, IMV

current recipe name

Opens “connectivity” panel opens “expert operation” panel

(double click)

save a recipe (double click)

delete a recipe (double click)

The project panel. A lot of piquet / expert functionality. Useful for piquet:

• MV voltage and current display

• HV AutoUpdate status

• manipulation with recipes: displays current recipe and full list of existing recipes; allows saving current datapoint values into a recipe

• open connectivity panel, displaying connectivity and settings of individual channels

• expert operations, for preparation of HV/LED recipes

Yu. Guz 2015/04/21 12

ECS HV control: xCAL

Voltages at CW power lines

manual control sectionFirst enable it!NB this pauses the “monitoring”! It resumes only on closing the panel

status of MV relays

DAC box common settings:HV ramp time; MV relay reaction time individual channel

operation panel. One can set the STANDBY and PHYSICS HV, as well as switch it OFF (“mask”).

Yu. Guz 2015/04/21 13

status of MV relays

MV relay controlBest to do at MV OFF

ECS HV control: xCAL

individual channel operation panel.

Yu. Guz 2015/04/21 14

ECS HV control: PRS Very similar functionality

Yu. Guz 2015/04/21 15

ECS HV control: PRS Very similar functionality

MV of each CW channel is protected with a relay.

Settings of individual channels

Yu. Guz 2015/04/21 16

CALO_HV_TOP panel (CA2)

Shows CALO HV status.

If number of channels ON is less than nominal (sometimes happens for ECAL, because of SPECS errors), the Go_READY command should be re-sent (use DEFAULT recipe, identical to PHYSICS).

Important figures are MV current consumptions. They are normally very stable(*), deviations may indicate real problems. The trends can be best displayed via lbTrending (next slide).

(*) the ECAL MV current slowly decreases, because of radiation effects in the central CW bases; this is normal.

Yu. Guz 2015/04/21 17

MV currents in lbTrendingUse shortcut /group/online/ecs/Shortcuts311/LHCb/LBECSINFO/LBECSINFO_UI_lbTrending.lnk

MV currents are being archived; any time interval can be displayed

Yu. Guz 2015/04/21 18

Error states, alarmsxCAL LV outputs for CWs

Protected by fuses: 1A conventional fuses || 0.5A resettable ones.

If LV values differ significantly from 6V, warning or alarm produced (visible at the shifter’s alarm screen, also with shortcut G:\online\ecs\Shortcuts38\LHCb\LBECSINFO\LBECSINFO_UI_fwAlarmHandlingScreen.lnk ). The limits are:

• U < 5.3 V : WARNING (yellow). The conventional fuse is burned, the resettable one is alive (which causes certain voltage drop). The CWs remain operational, the broken fuse is to be replaced at the next occasion (expert action).

• U < 3.5 V : ERROR (orange). Both conventional and resettable fuses are dead, the 20-40 CWs belonging to this power line are not operational (this will be visible by other means). The conventional fuse should be replaced as soon as possible.

xCAL MV relaysThe MV output of each CW power line is protected by a relay controlled by a protection system. It opens the relay in case of overcurrent (>100 mA). An open relay means that the 20-40 CWs belonging to this power line do not work. In this case an ERROR at the alarm screen is produced. Piquet action: • try to close the relay using the corresponding DAC box panel. • if unsuccessful: ‒ switch OFF HV then MV at this subdetector side‒ close the relay‒ switch ON MV then HV• if unsuccessful again, call expert. An access can be needed.

The FSM ERROR state can be produced because of SPECS errors. Check the LV ON state; try to switch the affected board(s) OFF and ON; restart the project and the SPECS server. If unsuccessful, one can exclude the affected DAC boxes from FSM; access may be necessary (e.g. to replace a dead DAC mezzanine).