Update on the Diphoton + MET Analysis Basckground

Bruce Schumm, Susan Fowler (Penn), Osamu Jinnouchi (Tokyo Tech), Khilesh

Mistry (Penn), Tobias Orthen (Tokyo Tech), Ryan Reese (SCIPP), Sheena Schier (SCIPP), Brig Williams (Penn)

25 November 2014 SUSY Group Analysis Meeting

25 November 2014 2

Conference Note public in early January:

Search for Supersymmetry in Diphoton Events with Large MissingTransverse Momentum in 8 TeV pp Collision Data with the ATLASDetector

ATLAS-CONF-2014-001

Since then…

25 November 2014 3

Complete retooling after loss of Ben Auerbach

Updated software/tools releases

“Harmonization” with other Photon + X + MET analyses

Re-thinking of approach to QCD background (big conceptual change, small numerical change)

FAR talk delivered 30 October presented new background numbers; based on Version 2.0 of backup note

https://cds.cern.ch/record/1700554 (ATL-COM-PHYS-2013-442)

Two sets of comments to address (Nikola from V2.0 reading, groups comments from FAR) to finalize background

Evaluate signal systematics

Set limits

25 November 2014 4

QCD Backgrounds Primer

Estimate with MC

Estimate via control sample

• Sum of contributions scaled to data for 0<MET<60

• Primary systematic from varying “” contribution between 0 and 50%

25 November 2014 5

New (vs. Old) Background Results

Note that QCD component uncertainties are >100%.

OLD

NEW

“OLD” is from CONF Note

25 November 2014 6

I: Responses to Questions Raised in FAR Talk

1. Add uncertainty on the gamma-gamma MC modeling of Etmiss (e.g. add JES, photon ES, etc)

Not yet done. However, given the large uncertainties on the QCD background component estimate, it is very unlikely to change things.

25 November 2014 7

2. Validate (e.g. using MC) that pseudo photon data (1 tight + 1 loose-not-tight) can model MET in gamma+jet and jet+jet data

We find that the diphoton MET distribution has somewhat smaller tails than the control sample MET distribution, suggesting that the QCD background estimate may be a bit high. However, since the lower end of our systematic range for all 5 SR's QCD background estimate is 0 events, we feel that we should add no additional systematic uncertainty based on this comparison.

-jet MC: control sample selection

-jet MC: diphoton sample selection

25 November 2014 8

3. Document well how the systematics are extracted on the QCD background (in particular the question was on the upper limit ofthe SP SRs where the central value of the expectation is 0).

SP1 & SP2

1)77% MC + 23% Control Sample NQCD < 0.11 @ 68% CL2)50% MC + 50% Control Sample NQCD < 0.23 @ 68% CL3)Since (0.11)2 + (0.21)2 = (0.23)2 we say

NQCD = 0.0 (+ 0.11 +0.21) (-0.00 -0.00)

WP1 & WP2

Central value and stat error (actual stat error

used is asymmetric Poisson)

Sys error range

25 November 2014 9

4. Look at the diphoton cross-section analysis and check if you can use the gam-gam vs gam+jet fraction from that paper as a function of e.g. pt(gg) instead of using the inclusive H->gg analysis.

From that paper, the fraction found for their selection is about 68%. For our result, we use 77%, with a systematic range between 50% and 100%. In addition, the MET and dphi distributions we observe for our selection suggest a larger, not a smaller, diphoton contribution than that suggested by the Higgs analysis. So we believe that the central value and range we have chosen make sense.

25 November 2014 10

5. Compare in one place the e->gamma fake factors and systematics of all photon+X analyses. (Related to this: Check that the systematics are evaluated consistently for all photon+X analyses when it should be the case (e.g. e->gamma fakes). The goal would be to be able to make a consistent description of the various analyses in the paper.)

We compared our fake factors to those of the photon+bjet+MET analysis. The latter are higher than the former by 20-25%. However, our photon isolation requirement is tighter than that of the photon+b analysis because we have found this beneficial in reducing backgrounds. In addition, it should be noted that the background levels are an order of magnitude higher in the photon+b analysis than in the diphoton analysis. Thus, the degree of scrutiny placed on the estimation of the e->g fake rates might be expected to be rather different for the two analyses. To us it doesn't make sense for the diphoton analysis to throw effort into reducing e->g fake rate uncertainties given the small contribution and the large statistical errors arising from the control sample. Thus, upon thinking about it a bit more, we don't find it warranted to expend effort in "harmonizing" the fake-rate determinations and errors between the diphoton group and the remaining photon+X+MET groups.

25 November 2014 11

6. Check the photon pt spectrum in the el->ph fake control region and in signal regions. This would be important if the FF turn out to be pt-dependent.

Rather than do this, we have instead explored the possible effect of a Pt dependence of the fake rate on the EW background estimate. Applying the Pt dependence measured by the photon+b analysis to our overall fake rate, we find a ~25% reduction in the EW background estimate. We now take this as an additional systematic uncertaintyon our EW background estimate, although the effect on the overall background estimate from the inclusion of this systematic is negligible (an increase of .01 events in the systematic error for the WP2 and MIS SRs; no change for the other SRs).

25 November 2014 12

7. Plot the photon Etmiss component and the other Etmiss components separately for data vs MC. Also add plots of the diphoton system

Still underway. Unlikely to impact final result.

8. Add a systematics band to data/MC comparisons (in particular because the modeling of Etmiss is not well-modeled on p.18)

Still underway. Unlikely to impact final result.

25 November 2014 13

9. Add upper Etmiss cut on Wgg CR to avoid overlap with SRs

The CR is now 50 < MET < 150. Since all events in the CR had MET<125, the "enhancement factor“ went up from 1.8 +- 1.0 to 2.3 +- 1.3.

Lepton- CR50 < MET < 150

25 November 2014 14

10. Add an uncertainty (e.g. 50%) to the bkgd contamination of the Wgg contamination and check the effect

We have included an overall 50% uncertainty on the total background contribution to the lepton-gg control region. The resulting uncertainty on the Wgg production rate is 23%. We conservatively add this in quadrature to the 55% uncertainty from other sources. It makes little difference in the overall background uncertainty in the SR.

11. Explain clearly why there is no extrapolation uncertainty on going from Wgg CR-> SR (question from Mario)

The K factor in question has a steep dependence on one variable: the magnitude of the momentum of the l system.However, above 100 GeV in this observable, the K factor levels out to its asymptotic value (which is about 20). On the other hand, the selection cuts for the various SRs bias the selection of W events to very high values of the l momentum - MC studies indicate that almost the entire contribution comes from events above 100 GeV. So as long as the control region itself has a lower bound of 100 GeV in this observable, we are measuring the correct region of phase space and there is no extrapolation to be done.

25 November 2014 15

II: Responses to selected CDS Questions From Nikola

1. Do you apply the BCH cleaning?

We have explored the effects of BCH cleaning on the signal and background MC selection efficiencies and found the effects to be negligible.

2. How do you know that MC simulation reproduces MET tails? Why do you want to set the relative fraction of your fake met samples using the H sample sample?

This has now been addressed above and in the prior FAR talk.

3. The QCD control sample needs to include backgrounds both from -jet and dijet events. The relative fractions of these contributions can depend on the kinematic cuts. Are the MET distributions the same for these two samples?

All the same kinematic cuts are applied to the control sample as to the signal sample, for each SR independently. In addition, all control sample events include at least one jet faking a (loose) photon, with a corresponding effect on the MET tail. So within the large (> 100%) uncertainties, we believe that this is incorporated in our range of uncertainty.

25 November 2014 16

4. Why you did not consider performing a fit to extract the relative fraction of the and -jet subsamples of the QCD background model?

In fact, we had wanted to do just that. However, in the control region, both samples (MC diphoton and the QCD control sample) overestimate the tight-isolated diphoton MET distribution for intermediate values of MET (between 50 and 100 GeV), with the MC diphoton distribution being much closer to the diphoton data than the control sample. Thus, it is clear that a fit would find that the sample is 100% diphoton. So in some sense we did do a fit, and include that result as a lower bound on the possible QCD background contribution.

25 November 2014 17

III: Updated Limit Results

Expected vs. observed by SR

Model-independent (number of event) limits from CONF Note

Re-calculated model-independent limits using CONF Note inputs

25 November 2014 18

Question: Do we exclude low-mass winos?

# events 95&CL is ~4 Yes, easily!

Yield, in # events

25 November 2014 19

Expected and observed limits by SR; new background results, full signal systematics

SP1

WP1

SP2

WP2

25 November 2014 20

Old/New Limits by Grid, New Background, Full Signal Systematics

26 August 2014 21

Analysis Strategy (lower reach of Wino-Bino limits)

Also: require ET > 75 GeV for each of the two photons

26 August 2014 22

MC Generation/Simulation Tasks

There were several issues to address that required more MC

•Low mass wino Extend grid from 300 GeV down to 100 GeV This is high cross-section/low-efficiency regime;

required working out filtering mechanism

•Low mass bino Extend explored bino mass reach down from 50 GeV to 10 GeV for all gluino, squark, and wino masses Requires care to avoid metastable states, direct gravitino decays (our model requires decay through bino)

•Nearly degenerate case for EW production (M_bino close to M_wino) Add points with m of 25 and 10 GeV Again need to watch for pathologies

Now done; awaiting analysis

26 August 2014 23

Analysis Tasks

• Increase jet ET cut from 20 to 40 GeV (M_eff reconstruction) very little change to anything

• Evaluate pT dependence of e fake rate play role in determination of EW background evaluated with “tag and probe” method No significant pT dependence observed

• Check grids developed for other signatures DISCUSS

26 August 2014 24

Background Studies

• Estimate H background Use existing H MC sample Pass through all 5 analysese Contributions at 10-2 level or less DONE

• Re-evaluate jet-MET uncertainty Inclusion of overflow bin made diphoton and control distributions much more similar Reduce uncertainty accordingly (small change in overall background uncertainty DONE

• Explore Wgg-background control region (l sample) for non-Wgg backgrounds This required developing the analysis from scratch since the sudden departure of Ben Aurebach Also want to add tt background just in case… Nominal subject of this talk

26 August 2014 25

New Wrinkle

• Comment on current version of Internal Note request that we update our analysis using BCH Cleaning

• In addition, we discovered that we had been unintentionally vetoing events containing identified muons, which was contrary to our intent

Are updating analysis, but need to see if this will have an appreciable effect on the backgrounds.

Note that this latter issue should not affect the Wgg analysis, since that explicitly requires events with muons, so no veto was applied.

26 August 2014 26

Wgg Background Studies

• New developments on W background calculation (Kaplan, Haas) Our “enhancement factor” of ~3 is relative to Alpgen Kaplan/Haas implement VBFNLO; see that Bozzi et al. NLO is consistent with Alpgen Expect no need for enhancement factor

Bozzi et al. Kaplan/Haas

26 August 2014 27

Background Studies: New Issue Cont’d

• On the other hand, our W background estimate based on (e,) control sample. Our “enhancement factor” of ~3 is relative to Alpgen Is this incompatible with Kaplan/Haas (phase space..) Have we missed some background to the l control sample? Can just expand error to include Kaplan/Haas result (but we do simultaneous fit… so need to understand how to do that!)

Includes x3 enhancement factor

W control region

From CONF Paper Internal Note

26 August 2014 28

Ed Board Request: Look for Z contamination in W control sample

Idea is to take l control sample, divide it into low and high MET (below and above 50 GeV) and look at the following quantities:

•PT(e), PT()

•M(e1), M(e2), M(e), M(), M(l)

•(MET,l), (MET,e), (MET,)

But….

26 August 2014 29

Re-Assessing the W Control Analysis

Re-inventedAnalysis

Although signal selection was validated, lepton selection was notSignal and MC down by x2 relative to CONF NOTE analysisExploring reasons for thisHave included tt; does not make much differenceX3 enhancement factor still consistent with data (see 3, expect 4.5), but based on 3 events rather than 8, so little statistical significance.

26 August 2014 30

Summary

• Our tools for doing analysis and selecting events are largely back in place.

• While we seem to be able to reproduce our sample, our l sample has not been reproduced.

• If we decide current analysis is correct, could lower photon pT cut to get more statistics in control sample

• One bug (muon veto) and one analysis improvement (BCH cleaning) force us to recalculate backgrounds once again, but changes should be small. Should be quickly followed through upon once we work out the l problem.

22 April 2014 31

BACKUP

17 June 2014 32

Interpretation/Limits

• Redo gluino/bino contour (changes very slight, except extension to Mbino < 50

• Set limit in squark/bino plane, including low bino mass

• Set limits in wino/bino plane, including lower limits (additional MC needed; hope to submit soon

• [Depending on manpower: Set limits in constrained SPS8 model (signal MC already in place)]

• Squark/bino limits done except low bino mass

17 June 2014 33

5 fb-1 analysis required ET > 50 GeV and

Analysis Strategy Continued

1 fb-1 analysis required

•ET > 25 GeV

•MET > 125 GeV

These will likely place lower limits on the wino mass than those of the 8 TeV analysis (which are still being determined)

Estimate of lower wino limit for 1 fb-1 analysis underway… but can we really include that in a paper? DISCUSS

Not good

17 June 2014 34