Scientific Computing at LEP

LEPfest 2000 Science SymposiumCERN, Wednesday 11 October 2000

David Williams

Slides at http://cern.ch/davidw/public/LEPfest.ppt

CaveatsI found this harder than I imagined it would beNo single person knows all parts of the storyIf you want to do a proper history and review it would take many months of researchSo I try to paint a pictureSurely a personal picture, with all the biases that impliesAnd in no way am I trying to assign credit to individuals

I have almost surely forgotten to mention some important aspects of the puzzle

AcknowledgementsExperiments plus early MEDDLE membersEspeciallyCarpenter, Cass, Cattaneo, Charpentier, Couet, Giani, Harvey, Hoejenbos, Gokieli, Jacobs, Jones, Knobloch, Newman, Robertson, von RdenApologies to the people I forgot!

But the errors and omissions, and there are surely some, are all mine...

More than fifteen yearsHalf a human generation, or five Internet generations

Todays really smart searchers after the Higgs were born in 1975-77They are as old as Microsoft [founded in 1975; released Windows 1.0 in 1985]They were 6-8 years old when we published Computing at CERN in the LEP Era in May 19838-10 years old when MEDDLE first met in May 1985If these whizz-kids parents had a computer then it was likely to be a Sinclair Z80, a Commodore C64 or a BBC MicroCisco didnt exist. [It shipped its first product in 1986 and went public in 1990.]

Commodore C64

The nature of the problem -People and their interactionsI suspect that the LHC experiments are running at the limit of what is feasibleNot the amount of funds that can be assembledOr the complexity of the detectorsBut the possibility of keeping such a large number of very smart people working enthusiastically and actively towards a common scientific goal

Until the mid-1980s HEPs computing problem was often thought to be about obtaining enough processor powerThen we worried about storage capacityThe real problem has always been, in my opinion, getting people to collaborate on a solution

PLANNING A necessary or an unnecessary evil?

Brecht OriginalJa, mach nur einen PlanSei nur ein grosses LichtUnd mach dann noch nen zweiten PlanGehn tun sie beide nicht

(Dreigroschenoper - Das Lied von der Unzulnglichkeit menschlichen Strebens)

TranslatedNow lets make a planShow forth a shining lightAnd then lets make a second planFor neither will be right

Pushing to get computing on the agendaIn November 1979 ECFA set up a committee on data handling and processing (co-chaired by Lillestol and Rimmer)That committee spawned ten working groups in Spring 1980 (SG5 on Networking, run by Sendall, was very influential)Although the General Meeting on LEP held at Villars in June 1981 had no plenary session on computing issues, there was a lot of work by the ECFA WGs and there is a rather extensive discussion, showing much wisdom, by John Mulvey in his closing remarksincludingThere have been passionate arguments this week over the choice of a standard among the different schemes available for data management.

The first planThe 1983 Green Book - Computing at CERN in the LEP EraCommissioned by Erwin Gabathuler (then Research Director)Three sections - DAQ, Networking, Offline (and a special annexe on Microprocessor Support)Plus a Steering Committee Report which was basically an argument for serious funding of LEP computing

Deliberately gave no funding total. Work over the following year concluded that CERN would need to invest some 50 MCHF over the following 5 years to implement the recommendations of the plan.

Green Book networkingGood stuff on architectureMove from CERNET to commercial backbone plus special purpose nets (controls, pits, buildings, inside computer centre, phones, ..)Choice of standard LANCERN should choose and support a standard LANEthernet was stated to be the obvious choice (but we stopped short of recommending it exclusively)

Digging deeperdiscussed Cambridge Ring and CATV MetronetsEstimates of users10-50 per experiment at CERN19-100 per experiment outside CERN (Europe, NA, ROW added)I looked for 64 kbps per student but couldnt find it

Green Book DAQFastbusBuilt-in processor power in front-end systems VAX will be the preferred family of 32-bit computersAdequate staffing of support services

Green Book Offline (i) Be careful of private computersDouble central batch capacity by 1987In retrospect we all had a poor understanding of Moores Law and its vital long-term impactEmulators to be driven by individual experimentsNeed for general (networked) file systemConceptual conversion of MSSBut no concept of worldwide system (like NFS or AFS)Need for Microprocessor SupportComputing for EngineersIn general the level of computer support for engineers at CERN is inadequate and needs to be improvedModern system needed for electronics design and VLSI

Green Book Offline (ii) InteractiveThis was the new idea - Did we need it? Was it a toy?Stay flexible - We were afraid to choose at this time - So do everything (CERN compromise!)Follow workstationsInstall a central VAX, which was an 8600VM/CMS pilot service (we were running MVS/Wylbur)

Green Book - Microprocessor SupportA final Appendix to the Green Book covered a topic which had been addressed separately, Microprocessor SupportMuch wisdom about the subject in generalAnd a recommendation to install a VAX-11/780 running Unix as the central support systemWith connections to CERNET and Index!

CERNs first mainline Unix service

Jobs for two DWs

Green Book generalRecommendation 20

We recommend that the Director responsible for computing should appoint a Deputy for Computing and Communications. We envisage this person being responsible for ensuring inter-divisional cooperation on a range of topics, including, for example, office automation, various special-purpose computing projects, and networks. In addition s/he would be the natural person to organise the inter-laboratory collaboration required for a successful European particle physics network

Not accepted!

An interlude to reflect on moneyComputing comes last (in time, I mean)And tends to get funded lastCannot make very sensible estimates 8-10 years before serious dataBut normally sufficiently well, in the end

LEP construction was not an easy time for CERN (tunneling)Led us into complicated stories of what CERN could provide as opposed to what experiments would have to provide for themselvesProbably should teach us that when we do develop sensible estimates for computing they should be respectedVery important to start well, since expectations are now high at machine start-up (of any machine..)

Ongoing planning - MEDDLEMEDDLE was created in May 1985Meeting between EP-Electronics, DD and the LEP ExperimentsRoughly four meetings per yearBrought together people responsible for CERN services (Director(s), DL(s), GLs) with the representatives of the experiments.Was it for planning, or more for discussions?

Certainly fulfilled a useful role in the early yearsMetamorphosed when other experiments grew in (computing) importance

Early MeddlingAmong other things the first meeting discussed how to handle the list of 27 topics which had been requested for discussion!Four follow-on meetings were scheduled:-NetworksSupport for PCs, workstations, and terminalsOfflineOnlineAnd the presentation on networking says:-Money is the only weapon!Therefore do not buy from non-OSI suppliers

A different sort of plan -MUSCLEIn January 1988 (18 months before first data) a much more detailed scenario was developed, with estimates for processor requirements at CERN, data volumes, tape mounting rates and external network needs.

It concluded that in the first year of running each experiment would need some 13.5 CERN units of processor power at CERN, and a similar amount outsideIt developed a model (extremely simplified precursor of MONARC) about how much I/O would be needed to (re) process and access the data

More MUSCLE..we insist that a dramatic increase in communications bandwidth will be essential if the hopes of distributing a significant fraction of the LEP computing load are to be realised.

.Although the bandwidth of a lorry-full of recorded cartridges is very high, such transport has to be planned days in advance, and it is certainly not flexible.

Regional CentresI am fairly sure that this report was the first use of the term Regional CentreTo qualify a centre needed:-2 CERN units at start-up, doubling two years later10 Gbytes!! of disk space at start-up, doubling two years lateraccess to 100s of 3480 cassettes at ~10 mounts/hour64 kbps link to CERN at start-up, upgraded to 2 Mbps two years laterOS and software environment as close to that at CERN as possiblesensible support services

The recommendation on bandwidth had an important and beneficial impact

The second planComputing at CERN in the 1990sStarted towards the end of Herwig Schoppers period as DG, in 1988, by John ThresherA bid for greater realism, in the sense that the computing problem was better understood, and the end of paying off the LEP debts was in sight So perhaps more money would be available, and a rather more credible scenario developed

But by the time it was ready there was a new DG, with his own ideas. The new plan didnt fit well with those ideas

It contained lots of ideas, many of them good. But much of the effort was wasted. Worth more study!

Ongoing planning - the COCOTIME annual reviewMEDDLE was created in May 1985COCOTIME had existed since ~1970, and was responsible at that time for allocating batch time among the experimentsStarting in 1994-95 it was morphed into an annual review with the experiments of the status of their computing and their technical and financial needs for the coming yearDirector, CN/IT management, and experiments (plus CCCR) then converge on the following year budget allocations and on the technical plans for implementation during the shut-downRather effective

THE PROCESSOR CAPACITY SAGA What was a CERN unit?

IBM 370/168 - the CERN Unit

Two CERN units per experimentIn the eighth meeting of the LEPC, held in June 1983, in the Open SessionWith respect to computing the Director-General stated that CERN cannot provide more than the equivalent of two 370/168 per LEP experiment.

Todays fast PCs are about 100 CERN units (370/168 power)In February 1983 ALEPH had estimated that they needed 12 CERN units for start-up (1988)The announced limitation was a very important political statement to the experimentsAnd introduced a lot of private computing

Three CERN units per experimentBy the time of the tenth LEPC in October 1985 we can read thatI[an] Butterworth presented the policy of the Directorate viz-a-viz data handling in the LEP era.[CERN] will, however, provide the equivalent of three IBM 168 per LEP experiment. (50% increase in 2+ years).

We should note that this commitment was actually preceded by a funding discussion (upping the computing investment line from 6 to 8 MCHF per year) which indicated an understanding that CPU power was not the only issue.

Siemens 7880 in 1985

Twelve CERN units in 1989In Jan 1988 the MUSCLE report had suggested that each experiment needed access to 13.5 CERN units at CERN in 1989Following the installation of the Cray X-MP/48 in 1987 it became possible to allocate twelve CERN units per experiment in 1989Even if not universally loved (vectorisation, access) the Cray was for some time very cost-effective and provided an extremely effective batch service during its working life at CERNIt was also our first mainframe running Unix, and CERN had a major role in pushing the rapid spread of that change among Cray users

How much CPU did we really use?In the year 2000 each LEP experiment has had access to roughly 2000 CERN units of batch capacity at CERNOr roughly 1000 times what they were warned in 1983 would be the limit of CERNs possibilities

Moores law (which predicts the doubling of the processor power every 18 months at roughly constant cost) predicts an increase of 1000 times over 15 years. QED.

BATCHCERNVM to SHIFT

Types of batchIn 1983, batch was batch, and you ran it on mainframesBut times were changingThe PC-XT was the state of the art (running with a 4.77 MHz 16-bit Intel 8088)The Macintosh, and the 68020, would be introduced in 1984Graphics workstations were starting to appear, with the pioneering, but ultimately unsuccessful PERQ from Three Rivers/ICL leading the way

We started to distinguish simulation from data intensive batch

CSFIn December 1991 the Central Simulation facility was assembled, based on 45 HP 9000/720 series workstations (Snakes) running Unix (HP-UX).This was CERNs first computer farm based on commodity equipment. Previous farms had been based on various generations of emulators.It offered a very significant price-performance improvement over conventional mainframes, with a software environment which was rather reasonable.

CSF in 1992

SHIFTAnother step was to explore the possibility of carrying out much more compute-intensive tasks than CSF could supportWork (HOPE) based on Apollo had not really generated enough I/O powerThen a joint project (SHIFT) between IT, Opal (Indiana), and Silicon Graphics, and using UltraNet to provide localised high-throughput I/O, was started in mid-1990, and became operational for the 1991 run.Over a few years this architecture matured and became CERNs default batch processing architecture. It then naturally developed into the PC farms that we can see today..

HOLDING THE DESKTOPS TOGETHERFrom CERNVM to NICE and PLUS

The dual role of the mainframeIn 1965 a computer was mainly a powerful calculatorBy 1975 a mainframe processed dataAnd by 1985, in addition to that role, it had started to provide the desktop environmentInitially mainly for dumb terminals connected via Index

But the number of users, and their needs, would grow fast:-Offsite accessSpread of LANs onsiteSpread of computer useExperiments wanting to work collaboratively (email, sharing programs and data)Hence, wish to see uniform logon environment

A growing number of usersThis uniform environment was provided de facto by CERNVM, and the number of users grew rapidly, even as the use of PCs and Macs took offIt reached a peak of ~4200 users/week in 1992-93Eventually the CERNVM service was turned off, after sterling efforts by many people to make a migration possible, in the middle of 1996

Weekly interactive users 1987-2000Number of Users each WeekWeekCERNVMWINDOWSVXCERNPLUS

Chart4

87011054087018701

87021129087028702

87031212087038703

87041245087048704

87051163087058705

87061305087068706

87071311087078707

87081213087088708

87091276087098709

87101323087108710

87111349087118711

87121382087128712

87131382087138713

87141348087148714

87151201087158715

87161123087168716

87171253087178717

87181337087188718

87191387087198719

87201346087208720

87211286087218721

87221378087228722

87231330087238723

87241446087248724

87251468087258725

87261435087268726

87271466087278727

87281418087288728

87291428087298729

87301432087308730

87311426087318731

87321424087328732

87331440087338733

87341446087348734

87351461087358735

87361433087368736

87371500087378737

87381526087388738

87391486087398739

87401624087408740

87411653087418741

87421680087428742

87431629087438743

87441678087448744

87451711087458745

87461738087468746

87471815087478747

87481842087488748

87491805087498749

87501737087508750

87511229087518751

87520087528752

88011560088018801

88021823088028802

88031863088038803

88041867088048804

88051908088058805

88061928088068806

88071917088078807

88081760088088808

88091845088098809

88101906088108810

88111971088118811

88122006088128812

88131825088138813

9231720088148814

11292049088158815

11782119088168816

11542101088178817

10492092088188818

9841898088198819

11782062088208820

11732058088218821

11362006088228822

11672095088238823

11912076088248824

12492057088258825

12142118088268826

12412096088278827

12552087088288828

8592049088298829

12302048088308830

11082036088318831

11381967088328832

11101976088338833

11871983088348834

02043088358835

11541972088368836

12942171088378837

12472176088388838

11382075088398839

12862255088408840

13482291088418841

13782338088428842

12012223088438843

02243088448844

14362342088458845

14122334088468846

14162391088478847

14552403088488848

15302380088498849

12782354088508850

12152071088518851

00088528852

12260089018901

14162222089028902

14592379089038903

15412436089048904

15372434089058905

14722387089068906

14572345089078907

15592526089088908

14812534089098909

15372495089108910

15382481089118911

14702298089128912

13862154089138913

15642482089148914

16032624089158915

14052594089168916

15572525089178917

14402232089188918

15432546089198919

15442538089208920

15672543089218921

16712688089228922

16712663089238923

16942676089248924

16692653089258925

15672603089268926

16322625089278927

17002580089288928

16872673089298929

17102658089308930

02745089318931

13692691089328932

16412743089338933

16992718089348934

17632863089358935

7322773089368936

17072780089378937

17882886089388938

18072868089398939

18162912089408940

18442944089418941

18793037089428942

18263179089438943

18532988089448944

18363295089458945

18483189089468946

18463174089478947

18573108089488948

17773222089498949

18233245089508950

16252968089518951

00089528952

12842486090019001

17203130090029002

17743147090039003

17693094090049004

18003174090059005

17813259090069006

17573218090079007

17252935090089008

18133211090099009

17433317090109010

18343416090119011

18093205090129012

18693281090139013

18373304090149014

16642944090159015

16602873090169016

18623277090179017

17673213090189018

17033335090199019

19303357090209020

17613225090219021

18263369090229022

18073292090239023

18803310090249024

18213326090259025

18053429090269026

17413448090279027

18543242090289028

18113214090299029

17683134090309030

17113001090319031

16082926090329032

15893053090339033

17083188090349034

17263261090359035

17133170090369036

16523155090379037

16643247090389038

03279090399039

17773371090409040

17643429090419041

18103459090429042

17423429090439043

17993403090449044

18963531090459045

18763597090469046

18173636090479047

18663594090489048

18743627090499049

18803547090509050

16353273090519051

00090529052

897598091019101

17273361091029102

18263466091039103

19163597091049104

17963547091059105

18313515091069106

19493608091079107

17913575091089108

19093581091099109

19423578091109110

18113530091119111

18633592091129112

17623468091139113

17133245091149114

17803643091159115

19823734091169116

19893644091179117

18943515091189118

18713418091199119

19893886091209120

19303576091219121

19283621091229122

19773715091239123

20543761091249124

20193728091259125

19893638091269126

20483696091279127

20593611091289128

20503610091299129

20103599091309130

19963568091319131

18773438091329132

17433301091339133

18333363091349134

19093470091359135

20073580091369136

20843758091379137

20733695091389138

21043796091399139

20663793091409140

21473907091419141

21713931091429142

21813934091439143

21473788091449144

21923941091459145

21823870091469146

20793877091479147

20733891091489148

21973948091499149

21243896091509150

19203685091519151

00091529152

00092019201

20073681092029202

21663841092039203

21073862092049204

21073861092059205

21783853092069206

21563892092079207

21493810092089208

21053922092099209

21423804092109210

21733833092119211

22243832092129212

21923811092139213

22193820092149214

22133917092159215

20673634092169216

19853504092179217

20333693092189218

21983872092199219

21784000092209220

21883846092219221

21573783092229222

22263882092239223

21243727092249224

22314100092259225

22483963092269226

23313942092279227

22874199092289228

21773702092299229

21323633092309230

21643646092319231

19993514092329232

19403517092339233

18793534092349234

21113657092359235

22123839092369236

22453784092379237

22303865092389238

22003888092399239

22993971092409240

22684062092419241

23604074092429242

23964129092439243

23334025092449244

23744180092459245

23324207092469246

22544221092479247

23294172092489248

23524167092499249

23204132092509250

22643993092519251

00092529252

20593556093019301

22583975093029302

22054002093039303

22084101093049304

22764069093059305

22884064093069306

22554076093079307

21483978093089308

22033940093099309

22423985093109310

22303993093119311

21573915093129312

22313937093139313

20733726093149314

20093557093159315

22373880093169316

22433844093179317

22314008093189318

22583985093199319

22313768093209320

22883954093219321

22233913093229322

22854022093239323

23194022093249324

23914054093259325

23453989093269326

23263919093279327

23593846093289328

23033763093299329

22333702093309330

20653635093319331

19663430093329332

19873544093339333

22333749093349334

24053935093359335

23563841093369336

22903881093379337

22933935093389338

23934016093399339

24834114093409340

23634121093419341

24394150093429342

23964094093439343

24994155093449344

25384188093459345

25704207093469346

24534146093479347

25004172093489348

24834047093499349

23413997093509350

00093519351

00093529352

18123364094019401

23623975094029402

23863970094039403

24614033094049404

25144072094059405

23484005094069406

23213904094079407

23833908094089408

22803878094099409

23283929094109410

23063925094119411

23983949094129412

21453583094139413

21493578094149414

23943918094159415

24413986094169416

23633803094179417

23313831094189418

22413668094199419

24463891094209420

23403874094219421

23603879094229422

23773852094239423

24563910094249424

23953899094259425

23963781094269426

24523829094279427

24103684094289428

23993569094299429

22073516094309430

21403486094319431

2050344213894329432

2047348117594339433

2229357718594349434

2348363618694359435

2401364714294369436

2511380016094379437

2520387322394389438

2516371222294399439

2450380422394409440

2479382822794419441

2398383723694429442

2460378618394439443

2385378022594449444

2496378125094459445

2533385726494469446

2511377428394479447

2625379730094489448

2404370429194499449

2435375528794509450

030156694519451

00094529452

1638351417695019501

2346358023295029502

2387362127495039503

2426364529195049504

2924366529895059505

2264357641495069506

2332345242695079507

2360344442995089508

2334349744795099509

2334344945195109510

2321339951295119511

2327340553195129512

2400337256995139513

2363341259895149514

2126316957295159515

2143312357295169516

2365343664195179517

2259321262695189518

2328328969995199519

2366335078495209520

2231319784995219521

2348332274095229522

2247323187595239523

2336322688795249524

2390325296995251315

2392320399495261306

23643190100495271265

2271300498995281218

22402792107395291184

22372799112495301173

21782800107095311195

20172678112895321205

19762697114395331219

21562800127595341232

22482850124895351284

22362879126695361293

22312815129095371327

23362767137195381313

23492818141395391375

22792868148595401466

22582865147895411419

22852866152495421449

22862881159795431485

22642770158895441383

24242875162195451514

23342845162695461523

23062891173095471546

23492893188395481557

23722856193395491520

22412801181195501534

00095510

00095520

1585181811869601614

21292688173696021570

21422573175196031587

21572620186796041627

21542614208396051641

20822518205496061551

20772501209396071683

21032452218696081516

21112454225996091535

21492469233496101564

21672445241196111628

20712372232896121709

20622295234396131735

19231966228396141623

18431964228796151571

20072060237896161722

20012053241496171727

19402044236296181736

19732009253196191809

19851922247996201733

20421843261996211797

19541830253996221529

20131841271896231773

20341821283196241821

20911767309496251839

20939626336396261809

20979627325496271784

19719628318796281605

18929629310796291583

18449630303096301567

17279631300796311593

13449632295796321645

15449633282996331632

16489634305096341611

17429635309096351623

17859636309496361678

18629637330696371802

18429638340896381853

17969639341396391865

18539640343296401888

18679641355596411951

18989642361096422003

18779643371196432010

17879644372196442015

18259645390096452033

18209646379696462047

18669647387196472057

17439648377996482059

17639649382296492065

17849650384796502092

16949651360496512000

09652154396520

654970113669701153

16109702333797021955

16879703354997031955

16289704360097041949

16619705364697051993

16129706370897062107

16879707366397071997

15869708369597082134

16589709365697092164

16589710381897102130

16199711242697112110

15719712368297122082

14619713338397132156

14159714347497141848

15819715373397152149

15029716371197162013

15019717364597172044

11299718356097182056

14669719365197192021

15859720382797202101

15619721374797212110

15159722386397222116

15579723391797232150

14729724381997242139

15619725400097252091

15169726412297262082

15299727404397272069

14729728388997282032

14649729377797291961

14139730383097301959

13799731379397311889

13019732372697321880

12219733350597331885

12819734366997341911

12849735374997351926

14519736405497361998

14499737408697371957

14259738419697382107

13599739399497392197

13979740411697402305

13779741428297412285

13729742421997422280

13799743429997432257

13739744421397442203

13519745437797452270

13639746430597462300

13329747426997472345

12379748424997482353

13119749438197492447

13179750434297502512

12699751407597510

7869752186797520

5759801180498010

1161980236461992152

1275980341032312333

1239980441612312330

1235980541672022346

1212980642062132347

1202980740732472336

1190980841242822440

1159980941222672334

1230981042592942461

1221981142573032467

1153981240272912429

1168981340742962471

1159981440012872466

1058981538122812230

1035981638212852281

1144981742643112490

1087981841553052442

1042981941963452561

1136982042163362550

1091982141173142455

1117982242863492503

1113982344322552349

1100982445603392606

1089982542363792594

1070982644333532471

1067982744843542532

937982844203322496

1054982943462892360

1049983043042842303

963983142143062290

891983240133042306

832983340053192240

812983439464002292

891983542593202333

1006983645013292527

1003983741363212426

993983846293432539

965983944123492532

988984045133852626

985984145223972631

971984246324002653

974984346214332666

954984445674112574

950984545824412736

948984646304642783

976984746924902798

955984845235002806

966984947585392832

909985041305152807

925985144194602722

63998522605113395

4429853191098539853

8119901366796347

889990243273872517

884990344724322727

854990443854622769

851990544044742742

868990644915182769

844990745685062758

852990844454942723

847990945704962765

816991045314882833

811991146035282847

785991243715412808

760991340615552803

744991441034842575

785991543745042554

777991644645532746

787991745405872789

753991844366132869

770991942466302831

802992045405712625

786992144696462755

789992247166312770

783992347526942911

793992448077312934

745992547287352877

760992648317302814

745992747897632850

738992847367672805

706992945677462666

679993046477832643

673993143887502605

571993240867532551

593993342507582495

648993444657922561

679993548657562598

696993648106112410

722993749647852632

714993850288312811

713993949818542813

695994049687982831

676994151107862816

674994252648272897

673994349718302857

663994446757682908

687994549158112879

665994650298642930

672994749558252927

664994848178392949

644994948128883022

646995045288743001

743995136407832861

33799523492175498

63100013971166367

793000247536532568

752000349357622807

711000450108412878

670000550458312914

629000650808922937

621000746878672932

629000848568592941

616000949468852790

606001048368852853

610001148118822881

588001247089112901

586001346218922922

580001450429542911

564001549709702927

547001648879742897

522001746798772662

557001846197672392

555001948239152838

554002051209712869

5530021503810012902

551002249589752856

551002345949662804

5510024478710532874

Weekly Users of Interactive Services 1987-1998

VXCERN

CERNVM

WGS and PLUS

Windows NT

Windows 95

Sheet2

Sheet2

87011054087018701

87021129087028702

87031212087038703

87041245087048704

87051163087058705

87061305087068706

87071311087078707

87081213087088708

87091276087098709

87101323087108710

87111349087118711

87121382087128712

87131382087138713

87141348087148714

87151201087158715

87161123087168716

87171253087178717

87181337087188718

87191387087198719

87201346087208720

87211286087218721

87221378087228722

87231330087238723

87241446087248724

87251468087258725

87261435087268726

87271466087278727

87281418087288728

87291428087298729

87301432087308730

87311426087318731

87321424087328732

87331440087338733

87341446087348734

87351461087358735

87361433087368736

87371500087378737

87381526087388738

87391486087398739

87401624087408740

87411653087418741

87421680087428742

87431629087438743

87441678087448744

87451711087458745

87461738087468746

87471815087478747

87481842087488748

87491805087498749

87501737087508750

87511229087518751

87520087528752

88011560088018801

88021823088028802

88031863088038803

88041867088048804

88051908088058805

88061928088068806

88071917088078807

88081760088088808

88091845088098809

88101906088108810

88111971088118811

88122006088128812

88131825088138813

9231720088148814

11292049088158815

11782119088168816

11542101088178817

10492092088188818

9841898088198819

11782062088208820

11732058088218821

11362006088228822

11672095088238823

11912076088248824

12492057088258825

12142118088268826

12412096088278827

12552087088288828

8592049088298829

12302048088308830

11082036088318831

11381967088328832

11101976088338833

11871983088348834

02043088358835

11541972088368836

12942171088378837

12472176088388838

11382075088398839

12862255088408840

13482291088418841

13782338088428842

12012223088438843

02243088448844

14362342088458845

14122334088468846

14162391088478847

14552403088488848

15302380088498849

12782354088508850

12152071088518851

00088528852

12260089018901

14162222089028902

14592379089038903

15412436089048904

15372434089058905

14722387089068906

14572345089078907

15592526089088908

14812534089098909

15372495089108910

15382481089118911

14702298089128912

13862154089138913

15642482089148914

16032624089158915

14052594089168916

15572525089178917

14402232089188918

15432546089198919

15442538089208920

15672543089218921

16712688089228922

16712663089238923

16942676089248924

16692653089258925

15672603089268926

16322625089278927

17002580089288928

16872673089298929

17102658089308930

02745089318931

13692691089328932

16412743089338933

16992718089348934

17632863089358935

7322773089368936

17072780089378937

17882886089388938

18072868089398939

18162912089408940

18442944089418941

18793037089428942

18263179089438943

18532988089448944

18363295089458945

18483189089468946

18463174089478947

18573108089488948

17773222089498949

18233245089508950

16252968089518951

00089528952

12842486090019001

17203130090029002

17743147090039003

17693094090049004

18003174090059005

17813259090069006

17573218090079007

17252935090089008

18133211090099009

17433317090109010

18343416090119011

18093205090129012

18693281090139013

18373304090149014

16642944090159015

16602873090169016

18623277090179017

17673213090189018

17033335090199019

19303357090209020

17613225090219021

18263369090229022

18073292090239023

18803310090249024

18213326090259025

18053429090269026

17413448090279027

18543242090289028

18113214090299029

17683134090309030

17113001090319031

16082926090329032

15893053090339033

17083188090349034

17263261090359035

17133170090369036

16523155090379037

16643247090389038

03279090399039

17773371090409040

17643429090419041

18103459090429042

17423429090439043

17993403090449044

18963531090459045

18763597090469046

18173636090479047

18663594090489048

18743627090499049

18803547090509050

16353273090519051

00090529052

897598091019101

17273361091029102

18263466091039103

19163597091049104

17963547091059105

18313515091069106

19493608091079107

17913575091089108

19093581091099109

19423578091109110

18113530091119111

18633592091129112

17623468091139113

17133245091149114

17803643091159115

19823734091169116

19893644091179117

18943515091189118

18713418091199119

19893886091209120

19303576091219121

19283621091229122

19773715091239123

20543761091249124

20193728091259125

19893638091269126

20483696091279127

20593611091289128

20503610091299129

20103599091309130

19963568091319131

18773438091329132

17433301091339133

18333363091349134

19093470091359135

20073580091369136

20843758091379137

20733695091389138

21043796091399139

20663793091409140

21473907091419141

21713931091429142

21813934091439143

21473788091449144

21923941091459145

21823870091469146

20793877091479147

20733891091489148

21973948091499149

21243896091509150

19203685091519151

00091529152

00092019201

20073681092029202

21663841092039203

21073862092049204

21073861092059205

21783853092069206

21563892092079207

21493810092089208

21053922092099209

21423804092109210

21733833092119211

22243832092129212

21923811092139213

22193820092149214

22133917092159215

20673634092169216

19853504092179217

20333693092189218

21983872092199219

21784000092209220

21883846092219221

21573783092229222

22263882092239223

21243727092249224

22314100092259225

22483963092269226

23313942092279227

22874199092289228

21773702092299229

21323633092309230

21643646092319231

19993514092329232

19403517092339233

18793534092349234

21113657092359235

22123839092369236

22453784092379237

22303865092389238

22003888092399239

22993971092409240

22684062092419241

23604074092429242

23964129092439243

23334025092449244

23744180092459245

23324207092469246

22544221092479247

23294172092489248

23524167092499249

23204132092509250

22643993092519251

00092529252

20593556093019301

22583975093029302

22054002093039303

22084101093049304

22764069093059305

22884064093069306

22554076093079307

21483978093089308

22033940093099309

22423985093109310

22303993093119311

21573915093129312

22313937093139313

20733726093149314

20093557093159315

22373880093169316

22433844093179317

22314008093189318

22583985093199319

22313768093209320

22883954093219321

22233913093229322

22854022093239323

23194022093249324

23914054093259325

23453989093269326

23263919093279327

23593846093289328

23033763093299329

22333702093309330

20653635093319331

19663430093329332

19873544093339333

22333749093349334

24053935093359335

23563841093369336

22903881093379337

22933935093389338

23934016093399339

24834114093409340

23634121093419341

24394150093429342

23964094093439343

24994155093449344

25384188093459345

25704207093469346

24534146093479347

25004172093489348

24834047093499349

23413997093509350

00093519351

00093529352

18123364094019401

23623975094029402

23863970094039403

24614033094049404

25144072094059405

23484005094069406

23213904094079407

23833908094089408

22803878094099409

23283929094109410

23063925094119411

23983949094129412

21453583094139413

21493578094149414

23943918094159415

24413986094169416

23633803094179417

23313831094189418

22413668094199419

24463891094209420

23403874094219421

23603879094229422

23773852094239423

24563910094249424

23953899094259425

23963781094269426

24523829094279427

24103684094289428

23993569094299429

22073516094309430

21403486094319431

2050344213894329432

2047348117594339433

2229357718594349434

2348363618694359435

2401364714294369436

2511380016094379437

2520387322394389438

2516371222294399439

2450380422394409440

2479382822794419441

2398383723694429442

2460378618394439443

2385378022594449444

2496378125094459445

2533385726494469446

2511377428394479447

2625379730094489448

2404370429194499449

2435375528794509450

030156694519451

00094529452

1638351417695019501

2346358023295029502

2387362127495039503

2426364529195049504

2924366529895059505

2264357641495069506

2332345242695079507

2360344442995089508

2334349744795099509

2334344945195109510

2321339951295119511

2327340553195129512

2400337256995139513

2363341259895149514

2126316957295159515

2143312357295169516

2365343664195179517

2259321262695189518

2328328969995199519

2366335078495209520

2231319784995219521

2348332274095229522

2247323187595239523

2336322688795249524

2390325296995251315

2392320399495261306

23643190100495271265

2271300498995281218

22402792107395291184

22372799112495301173

21782800107095311195

20172678112895321205

19762697114395331219

21562800127595341232

22482850124895351284

22362879126695361293

22312815129095371327

23362767137195381313

23492818141395391375

22792868148595401466

22582865147895411419

22852866152495421449

22862881159795431485

22642770158895441383

24242875162195451514

23342845162695461523

23062891173095471546

23492893188395481557

23722856193395491520

22412801181195501534

00095510

00095520

1585181811869601614

21292688173696021570

21422573175196031587

21572620186796041627

21542614208396051641

20822518205496061551

20772501209396071683

21032452218696081516

21112454225996091535

21492469233496101564

21672445241196111628

20712372232896121709

20622295234396131735

19231966228396141623

18431964228796151571

20072060237896161722

20012053241496171727

19402044236296181736

19732009253196191809

19851922247996201733

20421843261996211797

19541830253996221529

20131841271896231773

20341821283196241821

20911767309496251839

20939626336396261809

20979627325496271784

19719628318796281605

18929629310796291583

18449630303096301567

17279631300796311593

13449632295796321645

15449633282996331632

16489634305096341611

17429635309096351623

17859636309496361678

18629637330696371802

18429638340896381853

17969639341396391865

18539640343296401888

18679641355596411951

18989642361096422003

18779643371196432010

17879644372196442015

18259645390096452033

18209646379696462047

18669647387196472057

17439648377996482059

17639649382296492065

17849650384796502092

16949651360496512000

09652154396520

654970113669701153

16109702333797021955

16879703354997031955

16289704360097041949

16619705364697051993

16129706370897062107

16879707366397071997

15869708369597082134

16589709365697092164

16589710381897102130

16199711242697112110

15719712368297122082

14619713338397132156

14159714347497141848

15819715373397152149

15029716371197162013

15019717364597172044

11299718356097182056

14669719365197192021

15859720382797202101

15619721374797212110

15159722386397222116

15579723391797232150

14729724381997242139

15619725400097252091

15169726412297262082

15299727404397272069

14729728388997282032

14649729377797291961

14139730383097301959

13799731379397311889

13019732372697321880

12219733350597331885

12819734366997341911

12849735374997351926

14519736405497361998

14499737408697371957

14259738419697382107

13599739399497392197

13979740411697402305

13779741428297412285

13729742421997422280

13799743429997432257

13739744421397442203

13519745437797452270

13639746430597462300

13329747426997472345

12379748424997482353

13119749438197492447

13179750434297502512

12699751407597510

7869752186797520

5759801180498010

1161980236461992152

1275980341032312333

1239980441612312330

1235980541672022346

1212980642062132347

1202980740732472336

1190980841242822440

1159980941222672334

1230981042592942461

1221981142573032467

1153981240272912429

1168981340742962471

1159981440012872466

1058981538122812230

1035981638212852281

1144981742643112490

1087981841553052442

1042981941963452561

1136982042163362550

1091982141173142455

1117982242863492503

1113982344322552349

1100982445603392606

1089982542363792594

1070982644333532471

1067982744843542532

937982844203322496

1054982943462892360

1049983043042842303

963983142143062290

891983240133042306

832983340053192240

812983439464002292

891983542593202333

1006983645013292527

1003983741363212426

993983846293432539

965983944123492532

988984045133852626

985984145223972631

971984246324002653

974984346214332666

954984445674112574

950984545824412736

948984646304642783

976984746924902798

955984845235002806

966984947585392832

909985041305152807

925985144194602722

63998522605113395

4429853191098539853

8119901366796347

889990243273872517

884990344724322727

854990443854622769

851990544044742742

868990644915182769

844990745685062758

852990844454942723

847990945704962765

816991045314882833

811991146035282847

785991243715412808

760991340615552803

744991441034842575

785991543745042554

777991644645532746

787991745405872789

753991844366132869

770991942466302831

802992045405712625

786992144696462755

789992247166312770

783992347526942911

793992448077312934

745992547287352877

760992648317302814

745992747897632850

738992847367672805

706992945677462666

679993046477832643

673993143887502605

571993240867532551

593993342507582495

648993444657922561

679993548657562598

696993648106112410

722993749647852632

714993850288312811

713993949818542813

695994049687982831

676994151107862816

674994252648272897

673994349718302857

663994446757682908

687994549158112879

665994650298642930

672994749558252927

664994848178392949

644994948128883022

646995045288743001

743995136407832861

33799523492175498

63100013971166367

793000247536532568

752000349357622807

711000450108412878

670000550458312914

629000650808922937

621000746878672932

629000848568592941

616000949468852790

606001048368852853

610001148118822881

588001247089112901

586001346218922922

580001450429542911

564001549709702927

547001648879742897

522001746798772662

557001846197672392

555001948239152838

554002051209712869

5530021503810012902

551002249589752856

551002345949662804

5510024478710532874

Weekly Users of Interactive Services 1987-1998

VXCERN

CERNVM

WGS and PLUS

Windows NT

Windows 95

Sheet1

Sheet1

1054870100

1129870200

1212870300

1245870400

1163870500

1305870600

1311870700

1213870800

1276870900

1323871000

1349871100

1382871200

1382871300

1348871400

1201871500

1123871600

1253871700

1337871800

1387871900

1346872000

1286872100

1378872200

1330872300

1446872400

1468872500

1435872600

1466872700

1418872800

1428872900

1432873000

1426873100

1424873200

1440873300

1446873400

1461873500

1433873600

1500873700

1526873800

1486873900

1624874000

1653874100

1680874200

1629874300

1678874400

1711874500

1738874600

1815874700

1842874800

1805874900

1737875000

1229875100

0875200

1560880100

1823880200

1863880300

1867880400

1908880500

1928880600

1917880700

1760880800

1845880900

1906881000

1971881100

2006881200

1825881300

172092300

2049112900

2119117800

2101115400

2092104900

189898400

2062117800

2058117300

2006113600

2095116700

2076119100

2057124900

2118121400

2096124100

2087125500

204985900

2048123000

2036110800

1967113800

1976111000

1983118700

2043000

1972115400

2171129400

2176124700

2075113800

2255128600

2291134800

2338137800

2223120100

2243000

2342143600

2334141200

2391141600

2403145500

2380153000

2354127800

2071121500

0000

0122600

2222141600

2379145900

2436154100

2434153700

2387147200

2345145700

2526155900

2534148100

2495153700

2481153800

2298147000

2154138600

2482156400

2624160300

2594140500

2525155700

2232144000

2546154300

2538154400

2543156700

2688167100

2663167100

2676169400

2653166900

2603156700

2625163200

2580170000

2673168700

2658171000

2745000

2691136900

2743164100

2718169900

2863176300

277373200

2780170700

2886178800

2868180700

2912181600

2944184400

3037187900

3179182600

2988185300

3295183600

3189184800

3174184600

3108185700

3222177700

3245182300

2968162500

0000

2486128400

3130172000

3147177400

3094176900

3174180000

3259178100

3218175700

2935172500

3211181300

3317174300

3416183400

3205180900

3281186900

3304183700

2944166400

2873166000

3277186200

3213176700

3335170300

3357193000

3225176100

3369182600

3292180700

3310188000

3326182100

3429180500

3448174100

3242185400

3214181100

3134176800

3001171100

2926160800

3053158900

3188170800

3261172600

3170171300

3155165200

3247166400

3279000

3371177700

3429176400

3459181000

3429174200

3403179900

3531189600

3597187600

3636181700

3594186600

3627187400

3547188000

3273163500

0000

59889700

3361172700

3466182600

3597191600

3547179600

3515183100

3608194900

3575179100

3581190900

3578194200

3530181100

3592186300

3468176200

3245171300

3643178000

3734198200

3644198900

3515189400

3418187100

3886198900

3576193000

3621192800

3715197700

3761205400

3728201900

3638198900

3696204800

3611205900

3610205000

3599201000

3568199600

3438187700

3301174300

3363183300

3470190900

3580200700

3758208400

3695207300

3796210400

3793206600

3907214700

3931217100

3934218100

3788214700

3941219200

3870218200

3877207900

3891207300

3948219700

3896212400

3685192000

0000

0000

3681200700

3841216600

3862210700

3861210700

3853217800

3892215600

3810214900

3922210500

3804214200

3833217300

3832222400

3811219200

3820221900

3917221300

3634206700

3504198500

3693203300

3872219800

4000217800

3846218800

3783215700

3882222600

3727212400

4100223100

3963224800

3942233100

4199228700

3702217700

3633213200

3646216400

3514199900

3517194000

3534187900

3657211100

3839221200

3784224500

3865223000

3888220000

3971229900

4062226800

4074236000

4129239600

4025233300

4180237400

4207233200

4221225400

4172232900

4167235200

4132232000

3993226400

0000

3556205900

3975225800

4002220500

4101220800

4069227600

4064228800

4076225500

3978214800

3940220300

3985224200

3993223000

3915215700

3937223100

3726207300

3557200900

3880223700

3844224300

4008223100

3985225800

3768223100

3954228800

3913222300

4022228500

4022231900

4054239100

3989234500

3919232600

3846235900

3763230300

3702223300

3635206500

3430196600

3544198700

3749223300

3935240500

3841235600

3881229000

3935229300

4016239300

4114248300

4121236300

4150243900

4094239600

4155249900

4188253800

4207257000

4146245300

4172250000

4047248300

3997234100

0000

0000

3364181200

3975236200

3970238600

4033246100

4072251400

4005234800

3904232100

3908238300

3878228000

3929232800

3925230600

3949239800

3583214500

3578214900

3918239400

3986244100

3803236300

3831233100

3668224100

3891244600

3874234000

3879236000

3852237700

3910245600

3899239500

3781239600

3829245200

3684241000

3569239900

3516220700

3486214000

344220501380

348120471750

357722291850

363623481860

364724011420

380025111600

387325202230

371225162220

380424502230

382824792270

383723982360

378624601830

378023852250

378124962500

385725332640

377425112830

379726253000

370424042910

375524352870

30150660

0000

351416381760

358023462320

362123872740

364524262910

366529242980

357622644140

345223324260

344423604290

349723344470

344923344510

339923215120

340523275310

337224005690

341223635980

316921265720

312321435720

343623656410

321222596260

328923286990

335023667840

319722318490

332223487400

323122478750

322623368870

325223909691315

320323929941306

3190236410041265

300422719891218

2792224010731184

2799223711241173

2800217810701195

2678201711281205

2697197611431219

2800215612751232

2850224812481284

2879223612661293

2815223112901327

2767233613711313

2818234914131375

2868227914851466

2865225814781419

2866228515241449

2881228615971485

2770226415881383

2875242416211514

2845233416261523

2891230617301546

2893234918831557

2856237219331520

2801224118111534

0000

0000

181815851186614

2688212917361570

2573214217511587

2620215718671627

2614215420831641

2518208220541551

2501207720931683

2452210321861516

2454211122591535

2469214923341564

2445216724111628

2372207123281709

2295206223431735

1966192322831623

1964184322871571

2060200723781722

2053200124141727

2044194023621736

2009197325311809

1922198524791733

1843204226191797

1830195425391529

1841201327181773

1821203428311821

1767209130941839

9626209333631809

9627209732541784

9628197131871605

9629189231071583

9630184430301567

9631172730071593

9632134429571645

9633154428291632

9634164830501611

9635174230901623

9636178530941678

9637186233061802

9638184234081853

9639179634131865

9640185334321888

9641186735551951

9642189836102003

9643187737112010

9644178737212015

9645182539002033

9646182037962047

9647186638712057

9648174337792059

9649176338222065

9650178438472092

9651169436042000

9652015430

97016541366153

9702161033371955

9703168735491955

9704162836001949

9705166136461993

9706161237082107

9707168736631997

9708158636952134

9709165836562164

9710165838182130

9711161924262110

9712157136822082

9713146133832156

9714141534741848

9715158137332149

9716150237112013

9717150136452044

9718112935602056

9719146636512021

9720158538272101

9721156137472110

9722151538632116

9723155739172150

9724147238192139

9725156140002091

9726151641222082

9727152940432069

9728147238892032

9729146437771961

9730141338301959

9731137937931889

9732130137261880

9733122135051885

9734128136691911

9735128437491926

9736145140541998

9737144940861957

9738142541962107

9739135939942197

9740139741162305

9741137742822285

9742137242192280

9743137942992257

9744137342132203

9745135143772270

9746136343052300

9747133242692345

9748123742492353

9749131143812447

9750131743422512

9751126940750

975278618670

980157518040

9802116136462351

9803127541032564

9804123941612561

9805123541672548

9806121242062560

9807120240732583

9808119041242722

9809115941222601

9810123042592755

9811122142572770

9812115340272720

9813116840742767

9814115940012753

9815105838122511

9816103538212566

9817114442642801

9818108741552747

9819104241962906

9820113642162886

9821109141172769

9822111742862852

9823111344322604

9824110045602945

&A

Page &P

Weekly Users of Interactive Services 1987-1998

CERNVM

VXCERN

WGS and PLUS

NICE

Week

Total Number of Users

cernvm

WeekTOTALCERNVMUNIXNICEVXCERNPLUSWGSRSPLUSLXPLUSHPPLUSDXPLUSATLASCMSCHORUSIONNA48SLAPRPTHW95WNT

8701105410540000

8702112911290000

8703121212120000

8704124512450000

8705116311630000

8706130513050000

8707131113110000

8708121312130000

8709127612760000

8710132313230000

8711134913490000

8712138213820000

8713138213820000

8714134813480000

8715120112010000

8716112311230000

8717125312530000

8718133713370000

8719138713870000

8720134613460000

8721128612860000

8722137813780000

8723133013300000

8724144614460000

8725146814680000

8726143514350000

8727146614660000

8728141814180000

8729142814280000

8730143214320000

8731142614260000

8732142414240000

8733144014400000

8734144614460000

8735146114610000

8736143314330000

8737150015000000

8738152615260000

8739148614860000

8740162416240000

8741165316530000

8742168016800000

8743162916290000

8744167816780000

8745171117110000

8746173817380000

8747181518150000

8748184218420000

8749180518050000

8750173717370000

8751122912290000

8752000000

8801156015600000

8802182318230000

8803186318630000

8804186718670000

8805190819080000

8806192819280000

8807191719170000

8808176017600000

8809184518450000

8810190619060000

8811197119710000

8812200620060000

8813182518250000

8814264317200092300

88153178204900112900

88163297211900117800

88173255210100115400

88183141209200104900

8819288218980098400

88203240206200117800

88213231205800117300

88223142200600113600

88233262209500116700

88243267207600119100

88253306205700124900

88263332211800121400

88273337209600124100

88283342208700125500

8829290820490085900

88303278204800123000

88313144203600110800

88323105196700113800

88333086197600111000

88343170198300118700

88352043204300000

88363126197200115400

88373465217100129400

88383423217600124700

88393213207500113800

88403541225500128600

88413639229100134800

88423716233800137800

88433424222300120100

88442243224300000

88453778234200143600

88463746233400141200

88473807239100141600

88483858240300145500

88493910238000153000

88503632235400127800

88513286207100121500

88520000000

89011226000122600

89023638222200141600

89033838237900145900

89043977243600154100

89053971243400153700

89063859238700147200

89073802234500145700

89084085252600155900

89094015253400148100

89104032249500153700

89114019248100153800

89123768229800147000

89133540215400138600

89144046248200156400

89154227262400160300

89163999259400140500

89174082252500155700

89183672223200144000

89194089254600154300

89204082253800154400

89214110254300156700

89224359268800167100

89234334266300167100

89244370267600169400

89254322265300166900

89264170260300156700

89274257262500163200

89284280258000170000

89294360267300168700

89304368265800171000

89312745274500000

89324060269100136900

89334384274300164100

89344417271800169900

89354626286300176300

8936350527730073200

89374487278000170700

89384674288600178800

89394675286800180700

89404728291200181600

89414788294400184400

89424916303700187900

89435005317900182600

89444841298800185300

89455131329500183600

89465037318900184800

89475020317400184600

89484965310800185700

89494999322200177700

89505068324500182300

89514593296800162500

89520000000

90013770248600128400

90024850313000172000

90034921314700177400

90044863309400176900

90054974317400180000

90065040325900178100

90074975321800175700

90084660293500172500

90095024321100181300

90105060331700174300

90115250341600183400

90125014320500180900

90135150328100186900

90145141330400183700

90154608294400166400

90164533287300166000

90175139327700186200

90184980321300176700

90195038333500170300

90205287335700193000

90214986322500176100

90225195336900182600

90235099329200180700

90245190331000188000

90255147332600182100

90265234342900180500

90275189344800174100

90285096324200185400

90295025321400181100

90304902313400176800

90314712300100171100

90324534292600160800

90334642305300158900

90344896318800170800

90354987326100172600

90364883317000171300

90374807315500165200

90384911324700166400

90393279327900000

90405148337100177700

90415193342900176400

90425269345900181000

90435171342900174200

90445202340300179900

90455427353100189600

90465473359700187600

90475453363600181700

90485460359400186600

90495501362700187400

90505427354700188000

90514908327300163500

90520000000

910114955980089700

91025088336100172700

91035292346600182600

91045513359700191600

91055343354700179600

91065346351500183100

91075557360800194900

91085366357500179100

91095490358100190900

91105520357800194200

91115341353000181100

91125455359200186300

91135230346800176200

91144958324500171300

91155423364300178000

91165716373400198200

91175633364400198900

91185409351500189400

91195289341800187100

91205875388600198900

91215506357600193000

91225549362100192800

91235692371500197700

91245815376100205400

91255747372800201900

91265627363800198900

91275744369600204800

91285670361100205900

91295660361000205000

91305609359900201000

91315564356800199600

91325315343800187700

91335044330100174300

91345196336300183300

91355379347000190900

91365587358000200700

91375842375800208400

91385768369500207300

91395900379600210400

91405859379300206600

91416054390700214700

91426102393100217100

91436115393400218100

91445935378800214700

91456133394100219200

91466052387000218200

91475956387700207900

91485964389100207300

91496145394800219700

91506020389600212400

91515605368500192000

91520000000

92010000000

92025688368100200700

92036007384100216600

92045969386200210700

92055968386100210700

92066031385300217800

92076048389200215600

92085959381000214900

92096027392200210500

92105946380400214200

92116006383300217300

92126056383200222400

92136003381100219200

92146039382000221900

92156130391700221300

92165701363400206700

92175489350400198500

92185726369300203300

92196070387200219800

92206178400000217800

92216034384600218800

92225940378300215700

92236108388200222600

92245851372700212400

92256331410000223100

92266211396300224800

92276273394200233100

92286486419900228700

92295879370200217700

92305765363300213200

92315810364600216400

92325513351400199900

92335457351700194000

92345413353400187900

92355768365700211100

92366051383900221200

92376029378400224500

92386095386500223000

92396088388800220000

92406270397100229900

92416330406200226800

92426434407400236000

92436525412900239600

92446358402500233300

92456554418000237400

92466539420700233200

92476475422100225400

92486501417200232900

92496519416700235200

92506452413200232000

92516257399300226400

92520000000

93015615355600205900

93026233397500225800

93036207400200220500

93046309410100220800

93056345406900227600

93066352406400228800

93076331407600225500

93086126397800214800

93096143394000220300

93106227398500224200

93116223399300223000

93126072391500215700

93136168393700223100

93145799372600207300

93155566355700200900

93166117388000223700

93176087384400224300

93186239400800223100

93196243398500225800

93205999376800223100

93216242395400228800

93226136391300222300

93236307402200228500

93246341402200231900

93256445405400239100

93266334398900234500

93276245391900232600

93286205384600235900

93296066376300230300

93305935370200223300

93315700363500206500

93325396343000196600

93335531354400198700

93345982374900223300

93356340393500240500

93366197384100235600

93376171388100229000

93386228393500229300

93396409401600239300

93406597411400248300

93416484412100236300

93426589415000243900

93436490409400239600

93446654415500249900

93456726418800253800

93466777420700257000

93476599414600245300

93486672417200250000

93496530404700248300

93506338399700234100

93510000000

93520000000

94015176336400181200

94026337397500236200

94036356397000238600

94046494403300246100

94056586407200251400

94066353400500234800

94076225390400232100

94086291390800238300

94096158387800228000

94106257392900232800

94116231392500230600

94126347394900239800

94135728358300214500

94145727357800214900

94156312391800239400

94166427398600244100

94176166380300236300

94186162383100233100

94195909366800224100

94206337389100244600

94216214387400234000

94226239387900236000

94236229385200237700

94246366391000245600

94256294389900239500

94266177378100239600

94276281382900245200

94286094368400241000

94295968356900239900

94305723351600220700

94315626348600214000

943256303442138020500138457221

94335703348117502047017557772498

943459913577185022290185607927109

943561703636186023480186647728107

94366190364714202401014228762774

94376471380016002511016036812986

943866163873223025200223818442115

94396450371222202516022281894183

944064773804223024500223788641108

944165343828227024790227848339147

944264713837236023980236848842148

944364293786183024600183428140146

944463903780225023850225787944159

9445652737812500249602501037846167

9446665438572640253302641048157148

9447656837742830251102831208457139

9448672237973000262503001239360159

94496399370429102404029110693621911

9450647737552870243502871258353197

94513081301566000660048180

9452000000000000

95015328351417601638017679523096

9502615835802320234602321037230189

9503628236212740238702741248937168

9504636236452910242602911259840208

9505688736652980292402981329342238

950662543576414022641262881261388044188

950762103452426023321362901361318945178

950862333444429023601372921371299244198

950962783497447023341522951521308743278

951062343449451023341722791721199035278

95116232339951202321184328184129369536248

95126263340553102327198333198125459538228

95136341337256902400202367202155518943227

95146373341259802363210388210176539134277

95155867316957202126226346226137449439257

95165838312357202143224348224136429541277

951764423436641023652613802538148579843268

95186097321262602259266360256101455410129238

95196316328969902328300399286141565510146329

9520650033507840236636242233032169729248347

9521627731978490223140144836140187749944368

9522641033227400234830943127435165649953419

9523635332318750224741745838037190749549419

9524644932268870233647541239184174598847377

95257926325296913152390504465426781967698464181315

952678953203994130623925204744437721574104423451306

9527782331901004126523645084964258320798100463961265

952874823004989121822715144754298519689103443491218

9529728927921073118422405455284489721992113534291184

95307333279911241173223760951549711222092110493681173

9531724328001070119521785834874859819687114463861195

9532702826781128120520176294995221071977796804271205

9533703526971143121919765855584909521887949651121219

953474632800127512322156685590548137223961009860131232

953576302850124812842248678570527151232641099757111284

953676742879126612932236653613530123262791011016191293

953776632815129013272231679611535144249951031005681327

953877872767137113132336730641579151253981031146581313

953979552818141313752349742671580162289921051136571375

9540809828681485146622798146716251892741081031314691466

9541802028651478141922588346446351992501041031215881419

9542812428661524144922858356896451902731181101265481449

9543824928811597148522868957026812142791131031455391485

95448005277015881383226492366568923424211910014351101383

954584342875162115142424944677731213278119831394991514

954683282845162615232334900726738162281128961595391523

954784732891173015462306100372774026330010710315651101546

95488682289318831557234910867978212653521289815752101557

954986812856193315202372116476988128329813910715461101520

9550838728011811153422411104707809295271125981475881534

95510000000000000000

95520000000000000000

96015203181811866141585639547476163243837186559614

960281232688173615702129108065682225825610910011959131570

96038053257317511587214211056468332722571049711165121587

96048271262018671627215712056629132922945910312469131627

960584922614208316412154132475998533930412210514768131641

960682052518205415512082129875697032828112511316658131551

9607835425012093168320771362731101135128411411314167121683

9608825724522186151621031413773105935432112510314467131516

9609835924542259153521111477782106341432812710814857141535

9610851624692334156421491500834108741336414310214762161564

9611865124452411162821671542869112042233517711416467121628

9612848023722328170920711543785113241130616412110575141709

9613843522952343173520621596747117342330813610412168101735

9614779519662283162319231549734118036928913710912068111623

961576651964228715711843160568212113942781271081075481571

9616816720602378172220071614764118143332213511011869101722

9617819520532414172720011632782119244030816410412373101727

961880822044236217361940158278011644183171661051156891736

9619832220092531180919731684847123744736216110911983131809

9620811919222479173319851672807122644633716410910582101733

9621830118432619179720421778841126451434419010610091101797

962278521830253915291954167586412004753591981021217681529

96238345184127181773201318139051298515365226971218791773

9624850718212831182120341911920136554636520910913394101821

96258791176730941839209120901004144364740624111513596111839

9626726533631809209321761187153464246625212513410112971809

9627713532541784209720901164145363743425812113699111051784

9628676331871605197120211166137065144425712314088141001605

962965823107158318922011109613946174312281101427713951583

963064413030156718441965106513296364222261101159014881567

963163273007159317271970103713626083902199712910112891593

963259462957164513441925103213216043852119512310616961645

9633600528291632154418121017124456836920310312410713981632

9634630930501611164819231127132559840022911315312013991611

96356455309016231742191311771342571422231123159125101071623

96366557309416781785186812261339529463224127167116101191678

96376970330618021862203212741434598509234116170111121221802

9638710334081853184221231285146560949521243119166106131171853

963970743413186517962187122615186185147624010917099141181865

964071733432188818532224120815056497045323811316394181291888

96417373355519511867231312421520661132445243117177107121411951

96427511361020031898231212981531667114482247113192102131492003

96437598371120101877239713141614663120476273101199106131462010

96447523372120151787241913021627675117491248107199100121452015

96457758390020331825255713431616785156489265114197103151602033

96467663379620471820248213141620728134483244109191107171632047

96477794387120571866251913521641750128534243114187103141572057

96487581377920591743243613431598705133543240103170105161662059

96497650382220651763246413581603723138521260113178105141672065

965077233847209217842456139115767451355022989919310212161692092

965172983604200016942338126615356891144742569216310211141542000

965215431543009995446692161142121086957980000

9701217313661536548065604632381052031104666394587153

97026902333719551610220811291458641109427197991299814111541955

9703719135491955168723361213151070012646821311514210217121441955

9704717736001949162823541246154468112947520811716710625111371949

97057300364619931661237812681569688121482246931581042491521993

9706742737082107161224161292157671312748525410315410121101642107

9707734736631997168723461317154768311648925711017310222121521997

97087415369521341586238713081554710123511245105159992491562134

9709747836562164165823601296152771312057124111217462391602164

971076063818213016582397142115567141275672571231809827101592130

97116155242621101619110113252897071055462821051167630131572110

97127335368220821571232313591493694136491326110165912681422082

9713700033832156146121241259136664910946425799155992571532156

9714673734741848141521581316142164196470273119171902791571848

971574633733214915812356137715297111164902731221931052691592149

971672263711201315022328138315147031115012821191861082681532013

97177190364520441501233313121504701128435289115182962881592044

97186745356020561129225413061455676123465271109172972781572056

971971383651202114662285136614706821334832951021801072891622021

972075133827210115852446138115597461414812891091921102491672101

972174183747211015612351139614897351275232731081871072391662110

9722749438632116151523931470154472712258428612218210726101532116

9723762439172150155724371480158574111154031012418510530181682150

9724743038192139147224231396156074811549829210318710129111752139

9725765240002091156124931507159976313150333712022410531151722091

9726772041222082151625571565167074714051238310623010530131862082

9727764140432069152925271516159379414052932911121210030171882069

9728739338892032147223881501152474312153531712620310027131802032

972972023777196114642340143714867331214823121151959827141941961

9730720238301959141324121418151177812348530010718010628151971959

9731706137931889137923611432149174112947032012017310930151951889

9732690737261880130123621364149274512545430111016511324121851880

9733661135051885122122031302137570812041029310615610830141851885

9734686136691911128122511418144968711545433712015611331131941911

9735695937491926128422551494147867110652431912917811231111901926

9736750340541998145124261628158370913457734913319911231132141998

9737749240861957144924541632159072913559034512420812131122011957

9738772841962107142525841612167677613256132812322212236112092107

9739755039942197135924181576159671610652532012121812631122232197

9740781841162305139724991617159976513554333012022712131152302305

9741794442822285137725521730161080413859236311924812431102432285

9742787142192280137225651654162380214058332811524211332122292280

9743793542992257137925831716164479214761136312324610729102272257

9744778942132203137325471666160479814558635811123910731112232203

9745799843772270135126181759164282015658538912427811233142242270

9746796843052300136325611744159382014862436012224811332122332300

9747794642692345133225181751153983214767735811823110731112182345

9748783942492353123725691680161080115861434512822511633112082353

9749813943812447131126431738162685416363638312720211135112332447

9750817143422512131725891753161381715958442212422110436122502512

9751534440750126924551620153077415154335911821510537122310

975226531867078610178506353325026415475118551881580

980123791804057510487566623236321714054121621661400

980271583646235111612254139214277031244492881161979535112012152199

9803794241032564127524911612159575114554436211220911536122222333231

9804796141612561123925561605158881115756733110822410534122242330231

9805795041672548123525271640155781115959136510521810534112112346202

9806797842062560121225661640159279917557235411521510737122282347213

9807785840732583120224521621150477017855434311921010740132352336247

9808803641242722119025331591152376624453335011722310035122212440282

9809788241222601115924711651150775720760634911020810736122232334267

9810824442592755123025201739149980221964737712522210637132122461294

9811824842572770122124951762151976720961042012722711038122182467303

9812790040272720115323981629146175518254235811722511937122192429291

9813800940742767116824151659148974917758035410323711638122192471296

9814791340012753115924591542149975720348534410623010938112192466287

981573813812251110582303150913797501745202961112169837132182230281

9816742238212566103523281493143272916752529810719111034122162281285

9817820942642801114426061658158481920358535311022212139112172490311

9818798941552747108725111644153677819756635112122111339112222442305

9819814441962906104225551641157876421355036411322011739122262561345

9820823842162886113625691647154781320958132113422311839142172550336

9821797741172769109125061611147281721757334410921311233122152455314

9822825542862852111726101676155184621359436711921311137122232503349

9823814944322604111326561776156388021363938112421811937122462349255

9824860545602945110026931867160887021567344412122011840112402606339

98258298423629731089270715291600884223590423113010639132452594379

9826832744332824107026991734157189323556737912224512338112492471353

9827843744842886106727371747161793318758037311426611737122482532354

982881854420282893726761744155690721358038311125512236112462496332

9829804943462649105426281718149691022256337612624211837112452360289

9830794043042587104925851719149787221659139512520511435112432303284

983177734214259696324731741145882818759638512521811540132492290306

983275144013261089123621651138180417758237111418611436112372306304

98337396400525598322393161214227831885543649919911033112422240319

983474503946269281223801566139580218353434810119211631112332292400

983578034259265389125661693149687619455138811122512340102452333320

9836836345012856100626971804158889621360341611523112838132602527329

9837788641362747100324391697143382418264733511021610332102442426321

98388504462928829932726190315939002337103971182671183192532539343

983982584412288196526211791156485620165038910725011631102382532349

984085124513301198827121801155190126060437911828112036132502626385

984185354522302898527001822149694525963236510829310439102712631397

984286564632305397127641868150696429465038511728411339102702653400

984386944621309997427411880150094130064340711528111241112702666433

984485064567298595427431824150994628862240010326711337112712574411

98458709458231779502748183415589252656403841062641193792752736441

984688254630324794827531877156390528569140410929211539112162783464

984789564692328897627641928159190027372041311328812937132152798490

984887844523330695527041819151588830161636011233012136122322806500

984990954758337196628481910157695032264144311530212438142332832539

985083614130332290922511879151642531062748411325511538132342807515

985185264419318292525991820143586529961943910924312039142372722460

985237522605508639136512407085031543523548717371166181395113

9853235219100442944966511345882583104511265176153

99014921366744381122561411127173325247826410020210941621134796

990281204327290488926051722148082330257836410325312740162412517387

990385154472315988426701802152083831262438711626012638122392727432

990484704385323185426701715147686732757637010524611338152522769462

990584714404321685126741730148486832255740510925310842152412742474

990686464491328786826811810148886033361337910827812840142502769518

990786764568326484427201848149989033169736611225711839102492758506

990885144445321785226181827145982633369037511124910636132472723494

990986784570326184727331837153087732663038810728110942142662765496

991086684531332181626281903144586032362141511232111344142632833488

991187894603337581126671936147985333563047911129211040122622847528

991285054371334978525951776145182332160138910925311937132552808541

99138179406133587602384167713237632985873619423810730102502803555

99147906410330597442361174213297782545873869624911241122592575484

991582174374305878526061768145084031658835211827411743132632554504

991685404464329977726931771149586932959236311526212144132612746553

991787034540337678726691871146685534860842611526712140142802789587

991886714436348275326241812145084433058240511227611043122722869613

991984774246346177024981748135280334357438110922912143142772831630

99208538454031968022686185414628603646224019327712940132792625571

992186564469340178625871882141684033165139611026813247112672755646

992289064716340178927341982150287535769144011427113745142702770631

992391404752360578327701982152885738567247610826912845132712911694

992492654807366579327182089149985236766756511327513037122902934731

9925908547283612745275419741484989336861749011029713142122752877735

99269135483135447602883194815454889939161345711828812639132942814730

99279147478936137452824196515004588939062646110927413343153042850763

99289046473635727382738199815044284035263047412027613441143092805767

99298685456734127062646192114364781534859448111526112939122902666746

99308752464734266792655199214395183233359848311527513639113352643783

99318416438833556732546184213556279833158843110824013438142892605750

99327961408633045712335175112426073629758241310121812436112662551753

9933809642503253593246217881329637553155774559920712640122722495758

99348466446533536482543192213778075533159049011324314142132902561792

99358898486533546792776208915059584133567351812828114141122952598756

99368527481030216962707210314938976635969053012526814038103022410611

99379103496434177222799216515008784037270652112531013640133142632785

993893845028364271429262102156311089435968148612632213839112992811831

993993614981366771329102071155312285637965349411231313843103082813854

994092924968362969528802088160211977438564950311432013045103172831798

994193885110360267630242086157512088444563451610531312140103472816786

99429662526437246743110215415951299294576505481053161284093582897827

994393314971368767329781993155613787640962849010628711934103192857830

99449014467536766632743193214171248173856044579429812636113062908768

994592924915369068728502065153213279039662950612232012041103172879811

99469488502937946652948208115601528364006234901293621204193072930864

994793794955375267229112044150315983141864648211230711941103272927825

994892694817378866426792138156110859541566954811631112442113172949839

994993664812391064426982114150918757442864256911528513839113153022888

995090494528387564625721956144818557436559449810226612937113193001874

99