the extended global sky model (egsm)cmbworkshop2017.ucsd.edu/liu.pdfthe extended global sky model...

46
The extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill

Upload: others

Post on 15-Sep-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

The extended Global Sky Model (eGSM)

Adrian Liu, UC Berkeley/McGill

Page 2: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

The extended Global Sky Model (eGSM) project

AL, UC Berkeley/McGillDoyeon “Avery” Kim, UC BerkeleyEric Switzer, NASA Goddard Haoxuan “Jeff” Zheng, MIT/Intel

Page 3: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

What does the sky look like in all directions at “all” frequencies?

10 MHz

408 MHz

85 MHz

??????

Page 4: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

My motivation

Page 5: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Cosmic Microwave Background

21cm Cosmology

(See AL,et al. 2013 PRD 87, 043002 for more details)

Page 6: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

How does one model the sky?

Page 7: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Global Sky Model v1 (de Oliveira-Costa et al. 2008, MNRAS 388, 247)

Page 8: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Take a wide selection of survey data…

Page 9: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…identify common regions…

Page 10: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…which are then used to train three principal component

spectral templates…

Page 11: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…that are used to fit the spectra in every pixel of the sky…

Page 12: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…that are used to fit the spectra in every pixel of the sky…

T (r̂, ⌫) = m1(r̂)c1(⌫) +m2(r̂)c2(⌫) + . . .

Page 13: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…that are used to fit the spectra in every pixel of the sky…

T (r̂, ⌫) = m1(r̂)c1(⌫) +m2(r̂)c2(⌫) + . . .

Given these

Solve for these

Page 14: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…that are used to fit the spectra in every pixel of the sky…

Page 15: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…and are interpolated to produces maps of the sky at

“any” frequency

Page 16: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Global Sky Model v2 (Zheng… Kim, AL… et al. 2017, MNRAS 464, 3486)

Page 17: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Take an even wider selection of updated maps…

Page 18: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…now using six spectral components…

Page 19: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…and iteratively fitting for spectral and spatial information across the whole sky

Page 20: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…and iteratively fitting for spectral and spatial information across the whole sky

T (r̂, ⌫) = m1(r̂)c1(⌫) +m2(r̂)c2(⌫) + . . .

Given these

Solve for these

Page 21: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…and iteratively fitting for spectral and spatial information across the whole sky

T (r̂, ⌫) = m1(r̂)c1(⌫) +m2(r̂)c2(⌫) + . . .

Solve for these

Given these

Page 22: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…and iteratively fitting for spectral and spatial information across the whole sky

T (r̂, ⌫) = m1(r̂)c1(⌫) +m2(r̂)c2(⌫) + . . .

Given these

Solve for these

Page 23: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

…to derive even even better fits to the data.

Page 24: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Global Sky Model v3 (Kim, AL, Switzer 2017, in prep.)

Page 25: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Why three components? Why six components?Too few components: inadequate fits to data Too many components: overfitting of data

Page 26: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Computing the Bayesian Evidence provides a way to determine the optimal

number of principal components to fitIm

age

cred

it:

Zoub

in G

hahr

aman

i

Page 27: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Computing the Bayesian Evidence provides a way to determine the optimal

number of principal components to fit

Maximum likelihood

Greatest evidence

Imag

e cr

edit:

Zo

ubin

Gha

hram

ani

Page 28: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Optimal number of principal components

2 13

TFrequency [GHz]

Page 29: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Optimal number of principal components

2 13

Evid

ence

3 4 5 6 7

Page 30: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Optimal number of principal components

2 13

Evid

ence

3 4 5 6 7

Page 31: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Optimal number of principal components

2 13

Page 32: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

But why even commit to a model? Use evidence as a weight for constructing hybrid models that are noncommittal

to the number of componentsEv

iden

ce

3 4 5 6 7

Wei

ghts

Page 33: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

2 13

Effective number of principal components

Page 34: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

The old versions of the GSM had no error bars!

Page 35: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Solution: construct models for the errors in the input data, and Monte Carlo to

get final errors in our predictions

Page 36: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Solution: construct models for the errors in the input data, and Monte Carlo to

get final errors in our predictions• Where available, use provided estimates of errors

and covariances

LWA 74 MHz, Dowell et al. (2017)

Page 37: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Solution: construct models for the errors in the input data, and Monte Carlo to

get final errors in our predictions• Where available, use provided estimates of errors

and covariances

• Errors in the model itself modelled empirically

Page 38: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Run model again with an input map removed, making a prediction for the missing map

Page 39: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Subtract the new predicted map from the observed data

Prediction Data

=

“Error”

Page 40: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

“Error”

Ansatz for errors in image space:

proportional to error map

Ansatz for harmonic space:determined by Cl of whitened error map

Error model

Page 41: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

An example 408 MHz prediction

Page 42: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Errors on the 408 MHz prediction

Page 43: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Solution: construct models for the errors in the input data, and Monte Carlo to

get final errors in our predictions• Where available, use provided estimates of errors

and covariances

• Errors in the model itself modelled empirically

• Interpolation errors accounted for using Gaussian Process regression.

Page 44: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project
Page 45: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Lots more coming soon to a Github repo near you!

• Position-dependent number of components. • Error bars in output maps. • Framework for incorporating monopole

measurements. • Inclusion of new map data.

Page 46: The extended Global Sky Model (eGSM)cmbworkshop2017.ucsd.edu/Liu.pdfThe extended Global Sky Model (eGSM) Adrian Liu, UC Berkeley/McGill. The extended Global Sky Model (eGSM) project

Lots more coming soon to a Github repo near you!

• Position-dependent number of components. • Error bars in output maps. • Framework for incorporating monopole

measurements. • Inclusion of new map data.

End goal: a publicly hosted, self-updating, best-guess

model of the sky