get system overview - michigan state university...get system overview shebli anvar, cea irfu get...

i r f

ys la c

u

a

GET System OverviewGET System OverviewShebliAnvar,CEAIrfuShebliAnvar,CEAIrfu

GETWorkshop,Caen,FranceGETWorkshop,Caen,FranceMarch10‐12,2009March10‐12,2009

i r f

ys la c

u

aAGETAGET AGETAGET AGETAGETAGETAGET

ADCADC ADCADC ADCADCADCADC

AGETAGET AGETAGET AGETAGETAGETAGET






TPCTPC

AdditionalAdditionalSignalProcessingSignalProcessing

NetworkTransferNetworkTransfer

ASADReadoutASADReadout(ZeroSuppress)(ZeroSuppress)

MEM

ORY

MEM

ORY

GETNetworkSwitchGETNetworkSwitch

ComputerFarmComputerFarm

BEMBEMMUTANTMUTANT

TriggerTrigger

SyncCom

man

dsSyncCom

man

ds

Clock&Clock&

MultiplicitiesMultiplicities

GlobalNetworkGlobalNetwork

DataServerDataServer

OfflineOfflineAnalysisAnalysis

ExternalExternalSystemsSystems

Control&Control&MonitorinMonitorin

gg

ExternalExternal

i r f

ys la c

u

a AGETCircularMemory:10ns×512=5.12µsAGETCircularMemory:10ns×512=5.12µs⇒⇒L1triggerroundtripL1triggerroundtrip≤≤5µs(smallestcase)5µs(smallestcase)

EventEvent TriggerTrigger

••Thelaterthetrigger,themorecellstoreadThelaterthetrigger,themorecellstoread••TriggermustbelateenoughtoallowfordriftTriggermustbelateenoughtoallowfordrift⇒⇒TriggerI/Otiming:deterministicandconfigurableTriggerI/Otiming:deterministicandconfigurable

••Clockdistribution:100MHz,jitter~1nsClockdistribution:100MHz,jitter~1ns••Atleastonefullprecisionsynchronous«Atleastonefullprecisionsynchronous«startstart»»necessarynecessary••TimingcalibrationTimingcalibration

SameSameinfrastructureinfrastructureforsynchronouscommands?forsynchronouscommands?e.g.triggerI/O,readout,roundtriptimingcalibratione.g.triggerI/O,readout,roundtriptimingcalibration

integrationofclockandtriggerI/OcablingintegrationofclockandtriggerI/Ocabling

⇒⇒

++

i r f

ys la c

u

a

MUTANT/MUTANT/BEMBEM

COBOCOBO

ASADASADASADASADASADASADASADASAD




COBOCOBO

COBOCOBO

COBOCOBO

SameinfrastructureforclockandtriggerI/OSameinfrastructureforclockandtriggerI/O

MaxMaxnumbernumberofCOBOS:32ofCOBOS:32⇔⇔3686436864channelschannelsFrontpanel&Frontpanel&cratecratelimitslimits::daisydaisychainingchainingMUTANTSorMUTANTSorCOBOsCOBOs

i r f

ys la c

u

aMuTant‐BEMBoardMuTant‐BEMBoard

CoBoCoBo CoBoCoBo CoBoCoBo CoBoCoBo CoBoCoBo CoBoCoBo CoBoCoBo CoBoCoBo




Rank1Rank1

Rank0Rank0

Rank2Rank2

Rank3Rank3

3333

3333

Mux

4to1

CmdTS

Node 0

Node 1

Node 2

Node 3

MuTant link

Cm

d Interpreter

i r f

ys la c

u

aMuTant‐BEMBoardMuTant‐BEMBoard


Rank1Rank1

Rank0Rank0

MuTantSlaveMuTantSlave


Rank2Rank2

MuTantSlaveMuTantSlave


Connectmultiplicities

Connectmultiplicitiesoror

DistributeTriggerA

lgorithmDistributeTriggerA

lgorithm

i r f

ys la c

u

a

EmbeddedEmbeddedProcessorProcessor

TCP/IP

TCP/IP

Gigab

itEtherne

tsGigab

itEtherne

ts

AdditionalAdditionalSignalSignal

ProcessingProcessing

ASADReadoutASADReadout(Multiplicities/ZeroSuppress)(Multiplicities/ZeroSuppress)


TCP/IP

TCP/IP

Gigab

itEtherne

tsGigab

itEtherne

ts

MEM

ORY

MEM

ORY

MEM

ORY

2MEM

ORY

2

MemorybusisprobablythelimitingfactorMemorybusisprobablythelimitingfactorConsiderTCP/IPfirmwareco‐processing,DSP?ConsiderTCP/IPfirmwareco‐processing,DSP?ModulardesignfortheCOBOacquisitionsubsystemModulardesignfortheCOBOacquisitionsubsystem

Flip‐flopFlip‐flop/Circular/Circular

i r f

ys la c

u

a EmbeddedEmbeddedProcessorProcessor

•• AtleastforslowcontrolAtleastforslowcontrol•• PossiblyfordataacquisitionPossiblyfordataacquisition(70MByte/sunderVxWorksoverembeddedprocessor)(70MByte/sunderVxWorksoverembeddedprocessor)•• ChoiceofoperatingsystemChoiceofoperatingsystem

••LinuxLinux••««freefree»»••««samesame»»asdesktopasdesktop

••Real‐time(VxWorks,RTEMSReal‐time(VxWorks,RTEMS……))••driverdevelopmentmucheasierdriverdevelopmentmucheasier••bettercontrolthroughstrictprioritizationbettercontrolthroughstrictprioritization••VxWorkisnot«VxWorkisnot«freefree»»(developmentlicenceandruntime)(developmentlicenceandruntime)••RTEMSis«RTEMSis«freefree»»

SlowcontrolSlowcontrol

Acquisition?Acquisition?


SlowcontrolSlowcontrol

TCP/IP

TCP/IP

Gigab

itEtherne

tsGigab

itEtherne

ts

TCP/IP

TCP/IP

Ethe

rnet

Ethe

rnet

i r f

ys la c

u

a

•• Intrinsic parallelismIntrinsic parallelism–– Relates to detector spreadRelates to detector spread–– Static configurationStatic configuration–– High reliabilityHigh reliability

•• Performance parallelismPerformance parallelism–– Relates to available computing powerRelates to available computing power–– Dynamic configurationDynamic configuration–– Scalability, lower reliabilityScalability, lower reliability

AcquisitionAcquisitionNodesNodes(COBOs)(COBOs)


ComputingComputingNodesNodes

(LinuxPCs)(LinuxPCs)

RoutingbaProbablksedonTimestamp/EventnumbergivenbyRoutingbaProbablksedonTimestamp/EventnumbergivenbyMUTANTMUTANTSomeAdaptedDataFrameFormat(COBOfirmware)SomeAdaptedDataFrameFormat(COBOfirmware)

i r f

ys la c

u

a


ComputerFarmComputerFarm

GlobalNetworkGlobalNetwork

DataServerDataServer

OfflineOfflineAnalysisAnalysis

ExternalExternalSystemsSystems

Control&Control&MonitorinMonitorin

gg

••DistributedapplicationDistributedapplication••AdaptabletodifferentdetectorcontextsAdaptabletodifferentdetectorcontexts••AdaptabletodifferentfacilitycontextsAdaptabletodifferentfacilitycontexts

UseofmiddlewarefordistributedapplicationsUseofmiddlewarefordistributedapplicationsModularcomponentsModularcomponentsDeliverlibraries(C++and/orJava)forcontextintegrationDeliverlibraries(C++and/orJava)forcontextintegration

get system overview - michigan state university...get system overview shebli anvar, cea irfu get...

Documents