numerical focusing of a wide-field-angle earth radiation ......remote sens. 2020, 12, 176 2 of 15...

15
remote sensing Letter Numerical Focusing of a Wide-Field-Angle Earth Radiation Budget Imager Using an Artificial Neural Network Mehran Yarahmadi 1 , J. Robert Mahan 1, *, Kevin McFall 2 and Anum Barki Ashraf 3 1 Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24061, USA; [email protected] 2 Department of Mechatronics Engineering, Kennesaw State University, Kennesaw, GA 30144, USA; [email protected] 3 Climate Science Branch, NASA Langley Research Center, Hampton, VA 23666, USA; [email protected] * Correspondence: [email protected] Received: 8 December 2019; Accepted: 29 December 2019; Published: 3 January 2020 Abstract: Narrow field-of-view scanning thermistor bolometer radiometers have traditionally been used to monitor the earth’s radiant energy budget from low earth orbit (LEO). Such instruments use a combination of cross-path scanning and along-path spacecraft motion to obtain a patchwork of punctual observations which are ultimately assembled into a mosaic. Monitoring has also been achieved using non-scanning instruments operating in a push-broom mode in LOE and imagers operating in geostationary orbit. The current contribution considers a fourth possibility, that of an imager operating in LEO. The system under consideration consists of a Ritchey-Chrétien telescope illuminating a plane two-dimensional microbolometer array. At large field angles, the focal length of the candidate instrument is field-angle dependent, resulting in a blurred image in the readout plane. Presented is a full-field focusing algorithm based on an artificial neural network (ANN). Absorbed power distributions on the microbolometer array produced by discretized scenes are obtained using a high-fidelity Monte Carlo ray-trace (MCRT) model of the imager. The resulting readout array/scene pairs are then used to train an ANN. We demonstrate that a properly trained ANN can be used to convert the readout power distribution into an accurate image of the corresponding discretized scene. This opens the possibility of using an ANN based on a high-fidelity imager model for numerical focusing of an actual imager. Keywords: earth radiation budget monitoring; numerical focusing; image deblurring; artificial neural networks 1. Introduction Traditional earth radiation budget (ERB) instruments such as those deployed on the Earth Radiation Budget Experiment (ERBE) [1] and on Clouds and the Earth’s Radiant Energy System (CERES) [2] and proposed for the ultimately deselected Radiation Budget Instrument (RBI) [3] consist of downward-looking telescopes in low earth orbit (LOE) which scan back and forth across the orbital path, as illustrated in Figure 1. While proven eective, such systems incur significant weight and power penalties and may be susceptible to eventual mechanical failure. Another approach to accomplishing the ERB mission is the Geostationary Earth Radiation Budget (GERB) instrument, which consists of a three-mirror imager illuminating a microbolometer focal-plane array (FPA) [4]. The ERB mission will also be assured by EarthCARE (earth, clouds, aerosols, and radiation explorer), which includes a Broadband Radiometer (BBR) suite consisting of three sets of two-dimensional paraboloid single-mirror optics, each illuminating a microbolometer linear array [5]. Both GERB and BBR rely on optical approaches to avoid scanning. In the case of GERB the field angle is limited by the extreme altitude of Remote Sens. 2020, 12, 176; doi:10.3390/rs12010176 www.mdpi.com/journal/remotesensing

Upload: others

Post on 29-Jan-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

  • remote sensing

    Letter

    Numerical Focusing of a Wide-Field-Angle EarthRadiation Budget Imager Using an ArtificialNeural Network

    Mehran Yarahmadi 1 , J. Robert Mahan 1,*, Kevin McFall 2 and Anum Barki Ashraf 3

    1 Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24061, USA; [email protected] Department of Mechatronics Engineering, Kennesaw State University, Kennesaw, GA 30144, USA;

    [email protected] Climate Science Branch, NASA Langley Research Center, Hampton, VA 23666, USA; [email protected]* Correspondence: [email protected]

    Received: 8 December 2019; Accepted: 29 December 2019; Published: 3 January 2020�����������������

    Abstract: Narrow field-of-view scanning thermistor bolometer radiometers have traditionally beenused to monitor the earth’s radiant energy budget from low earth orbit (LEO). Such instrumentsuse a combination of cross-path scanning and along-path spacecraft motion to obtain a patchworkof punctual observations which are ultimately assembled into a mosaic. Monitoring has also beenachieved using non-scanning instruments operating in a push-broom mode in LOE and imagersoperating in geostationary orbit. The current contribution considers a fourth possibility, that of animager operating in LEO. The system under consideration consists of a Ritchey-Chrétien telescopeilluminating a plane two-dimensional microbolometer array. At large field angles, the focal lengthof the candidate instrument is field-angle dependent, resulting in a blurred image in the readoutplane. Presented is a full-field focusing algorithm based on an artificial neural network (ANN).Absorbed power distributions on the microbolometer array produced by discretized scenes areobtained using a high-fidelity Monte Carlo ray-trace (MCRT) model of the imager. The resultingreadout array/scene pairs are then used to train an ANN. We demonstrate that a properly trained ANNcan be used to convert the readout power distribution into an accurate image of the correspondingdiscretized scene. This opens the possibility of using an ANN based on a high-fidelity imager modelfor numerical focusing of an actual imager.

    Keywords: earth radiation budget monitoring; numerical focusing; image deblurring; artificialneural networks

    1. Introduction

    Traditional earth radiation budget (ERB) instruments such as those deployed on the EarthRadiation Budget Experiment (ERBE) [1] and on Clouds and the Earth’s Radiant Energy System(CERES) [2] and proposed for the ultimately deselected Radiation Budget Instrument (RBI) [3] consistof downward-looking telescopes in low earth orbit (LOE) which scan back and forth across the orbitalpath, as illustrated in Figure 1. While proven effective, such systems incur significant weight and powerpenalties and may be susceptible to eventual mechanical failure. Another approach to accomplishingthe ERB mission is the Geostationary Earth Radiation Budget (GERB) instrument, which consists ofa three-mirror imager illuminating a microbolometer focal-plane array (FPA) [4]. The ERB missionwill also be assured by EarthCARE (earth, clouds, aerosols, and radiation explorer), which includes aBroadband Radiometer (BBR) suite consisting of three sets of two-dimensional paraboloid single-mirroroptics, each illuminating a microbolometer linear array [5]. Both GERB and BBR rely on opticalapproaches to avoid scanning. In the case of GERB the field angle is limited by the extreme altitude of

    Remote Sens. 2020, 12, 176; doi:10.3390/rs12010176 www.mdpi.com/journal/remotesensing

    http://www.mdpi.com/journal/remotesensinghttp://www.mdpi.comhttps://orcid.org/0000-0003-1907-3018https://orcid.org/0000-0003-4085-0109http://www.mdpi.com/2072-4292/12/1/176?type=check_update&version=1http://dx.doi.org/10.3390/rs12010176http://www.mdpi.com/journal/remotesensing

  • Remote Sens. 2020, 12, 176 2 of 15

    the instrument, which is parked in geostationary orbit. The narrow field angle significantly simplifiesthe optical design, and scanning is then achieved by the rotation of the Earth. The BBR suite onEarthCARE achieves optical simplification by push-broom operation and the use of a linear array; as inthe case of scanning instruments, light gathering is limited to the width of a single pixel. The currentcontribution considers a novel approach in which a wide-field-angle imager is placed in LOE and theresulting astigmatism is corrected algorithmically.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 2 of 16

    BBR rely on optical approaches to avoid scanning. In the case of GERB the field angle is limited by the extreme altitude of the instrument, which is parked in geostationary orbit. The narrow field angle significantly simplifies the optical design, and scanning is then achieved by the rotation of the Earth. The BBR suite on EarthCARE achieves optical simplification by push-broom operation and the use of a linear array; as in the case of scanning instruments, light gathering is limited to the width of a single pixel. The current contribution considers a novel approach in which a wide-field-angle imager is placed in LOE and the resulting astigmatism is corrected algorithmically.

    Figure 2 is a CERES science product showing the monthly average global outgoing longwave radiation for May 2001 [6]. The CERES longwave channel is filtered to be sensitive only to earth-emitted radiation. The false-color map of monthly average band-limited flux (Wm−2) is relatively free of sharp edges and finely resolved features. This is equally true of the CERES shortwave channel, which is filtered to be sensitive only to earth-reflected solar radiation. The fact that scenes are effectively monochromatic and vary gradually within a given swath significantly limits their frequency content. A requirement of any next-generation staring imager is that it produces data products capable of mimicking those obtained from legacy scanners. In other words, images obtained must be relatable to the scanner footprints shown in Figure 1. Consequently, it is appropriate to represent earth scenes as consisting of a relatively modest number of directional beams.

    Figure 1. Radiation budget instrument (RBI) [3] scan pattern.

    Figure 2. Global outgoing longwave radiation as mapped using data from the Clouds and the Earth’s Radiant Energy System (CERES) instrument (May, 2001 [6]).

    Figure 3 represents a generic wide-field-angle ERB imager consisting of an entrance aperture, baffled imaging optics, and a plane two-dimensional readout array. Two beams of radiation emanating from point sources at infinity are shown flooding the entrance aperture. Corresponding point-spread functions (PSFs) in the readout plane indicate the distribution of the beam energy there.

    Figure 1. Radiation budget instrument (RBI) [3] scan pattern.

    Figure 2 is a CERES science product showing the monthly average global outgoing longwaveradiation for May 2001 [6]. The CERES longwave channel is filtered to be sensitive only to earth-emittedradiation. The false-color map of monthly average band-limited flux (Wm−2) is relatively free of sharpedges and finely resolved features. This is equally true of the CERES shortwave channel, which isfiltered to be sensitive only to earth-reflected solar radiation. The fact that scenes are effectivelymonochromatic and vary gradually within a given swath significantly limits their frequency content.A requirement of any next-generation staring imager is that it produces data products capable ofmimicking those obtained from legacy scanners. In other words, images obtained must be relatable tothe scanner footprints shown in Figure 1. Consequently, it is appropriate to represent earth scenes asconsisting of a relatively modest number of directional beams.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 2 of 16

    BBR rely on optical approaches to avoid scanning. In the case of GERB the field angle is limited by the extreme altitude of the instrument, which is parked in geostationary orbit. The narrow field angle significantly simplifies the optical design, and scanning is then achieved by the rotation of the Earth. The BBR suite on EarthCARE achieves optical simplification by push-broom operation and the use of a linear array; as in the case of scanning instruments, light gathering is limited to the width of a single pixel. The current contribution considers a novel approach in which a wide-field-angle imager is placed in LOE and the resulting astigmatism is corrected algorithmically.

    Figure 2 is a CERES science product showing the monthly average global outgoing longwave radiation for May 2001 [6]. The CERES longwave channel is filtered to be sensitive only to earth-emitted radiation. The false-color map of monthly average band-limited flux (Wm−2) is relatively free of sharp edges and finely resolved features. This is equally true of the CERES shortwave channel, which is filtered to be sensitive only to earth-reflected solar radiation. The fact that scenes are effectively monochromatic and vary gradually within a given swath significantly limits their frequency content. A requirement of any next-generation staring imager is that it produces data products capable of mimicking those obtained from legacy scanners. In other words, images obtained must be relatable to the scanner footprints shown in Figure 1. Consequently, it is appropriate to represent earth scenes as consisting of a relatively modest number of directional beams.

    Figure 1. Radiation budget instrument (RBI) [3] scan pattern.

    Figure 2. Global outgoing longwave radiation as mapped using data from the Clouds and the Earth’s Radiant Energy System (CERES) instrument (May, 2001 [6]).

    Figure 3 represents a generic wide-field-angle ERB imager consisting of an entrance aperture, baffled imaging optics, and a plane two-dimensional readout array. Two beams of radiation emanating from point sources at infinity are shown flooding the entrance aperture. Corresponding point-spread functions (PSFs) in the readout plane indicate the distribution of the beam energy there.

    Figure 2. Global outgoing longwave radiation as mapped using data from the Clouds and the Earth’sRadiant Energy System (CERES) instrument (May, 2001 [6]).

    Figure 3 represents a generic wide-field-angle ERB imager consisting of an entrance aperture,baffled imaging optics, and a plane two-dimensional readout array. Two beams of radiation emanating

  • Remote Sens. 2020, 12, 176 3 of 15

    from point sources at infinity are shown flooding the entrance aperture. Corresponding point-spreadfunctions (PSFs) in the readout plane indicate the distribution of the beam energy there. Depending onthe design of the optical train, focus will generally be achieved on a curved rather than on a planesurface. This is especially true when two-mirror optical systems of the Cassegrain or Ritchey-Chrétientype are pushed to their wide-field-angle limits. While deemed achievable, technology permittingnon-planar microbolometer readout arrays has not yet been demonstrated. Therefore, we limit ourconsideration here to plane readout arrays, in which case blurring is expected to vary with field angleacross the readout array. The challenge then is to create an accurate and computationally efficientalgorithm for recovering the original discretized scene from the blurred illumination pattern on thereadout array.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 3 of 16

    Depending on the design of the optical train, focus will generally be achieved on a curved rather than on a plane surface. This is especially true when two-mirror optical systems of the Cassegrain or Ritchey-Chrétien type are pushed to their wide-field-angle limits. While deemed achievable, technology permitting non-planar microbolometer readout arrays has not yet been demonstrated. Therefore, we limit our consideration here to plane readout arrays, in which case blurring is expected to vary with field angle across the readout array. The challenge then is to create an accurate and computationally efficient algorithm for recovering the original discretized scene from the blurred illumination pattern on the readout array.

    Figure 3. Schematic representation of a generic wide-field-angle earth radiation budget staring imager.

    2. Image Deblurring

    Following the formality of Pratt [7] the deblurring problem can be posed as 𝐻 𝑓 𝑥, 𝑦 ≡ ℎ 𝑥 − 𝑢, 𝑦 − 𝑣 𝑓 𝑢, 𝑣 𝑑𝑢𝑑𝑣 = 𝑔 𝑥, 𝑦 𝑛 𝑥, 𝑦≡ 𝑔 𝑥, 𝑦 , (1) where 𝑓 𝑥, 𝑦 is the deblurred image, 𝑔 𝑥, 𝑦 is the blurred image that would have been recorded in the absence of noise 𝑛 𝑥, 𝑦 , 𝑔 𝑥, 𝑦 is the actual recorded image, ℎ is a point-spread function (PSF), and 𝐻 is an unknown matrix defined by the expression. In the discrete version of Equation (1) the double integral is replaced by a double sum over a discretized two-dimensional space. Then elements of the matrix 𝐻 are sought such that 𝑓 = 𝐻 𝑔 , (2) where the indices 𝑖 and 𝑗 represent ordered pixel numbers in a two-dimensional array. Then 𝑓 is the deblurred intensity of pixel 𝑖 and 𝑔 is the recorded intensity of pixel 𝑗 . It should be emphasized that in discretized two-dimensional space both the deblurred image 𝑓 and the recorded image 𝑔 are defined by the same number of pixels; that is, 𝐻 is a square matrix. While posed here as a problem in the space domain, practical implementation typically occurs in the frequency domain, in which case the Fourier transform dual of the PSF is the optical transfer function (OTF). Heuristically, deblurring involves deconvolution of either Equation (1), or its frequency-domain dual. In the case of non-blind deblurring, when the PSF (or OTF) is uniform and known across the image, the Lucy-Richardson algorithm [8,9] can be used to solve Equation (1). When the PSF is unknown it can often be reasonably modeled, for example as a Gaussian distribution having an unknown mean and variance. In this case the problem is ill-posed but can still be solved if an independent criterion for “good focus” is available against which the success of the solution can be evaluated. In such so-called blind deconvolution schemes a systemic search based on, for example, a genetic algorithm (GM) [10], can be conducted to identify the combination of deblurred images and

    Two Collimated

    Beams

    Aperture

    Baffled Imaging Optics

    Plane Readout

    Array

    Figure 3. Schematic representation of a generic wide-field-angle earth radiation budget staring imager.

    2. Image Deblurring

    Following the formality of Pratt [7] the deblurring problem can be posed as

    H f (x, y) ≡∫ ∫

    h(x− u, y− v) f (u, v)dudv = ge(x, y) + n(x, y)≡ g(x, y),

    (1)

    where f (x, y) is the deblurred image, ge(x, y) is the blurred image that would have been recorded inthe absence of noise n(x, y), g(x, y) is the actual recorded image, h is a point-spread function (PSF),and H is an unknown matrix defined by the expression. In the discrete version of Equation (1) thedouble integral is replaced by a double sum over a discretized two-dimensional space. Then elementsof the matrix Hi j are sought such that

    fi = H−1i j g j, (2)

    where the indices i and j represent ordered pixel numbers in a two-dimensional array. Then fi is thedeblurred intensity of pixel i and g j is the recorded intensity of pixel j. It should be emphasized that indiscretized two-dimensional space both the deblurred image fi and the recorded image g j are definedby the same number of pixels; that is, Hi j is a square matrix. While posed here as a problem in the spacedomain, practical implementation typically occurs in the frequency domain, in which case the Fouriertransform dual of the PSF is the optical transfer function (OTF). Heuristically, deblurring involvesdeconvolution of either Equation (1), or its frequency-domain dual. In the case of non-blind deblurring,when the PSF (or OTF) is uniform and known across the image, the Lucy-Richardson algorithm [8,9]can be used to solve Equation (1). When the PSF is unknown it can often be reasonably modeled, forexample as a Gaussian distribution having an unknown mean and variance. In this case the problemis ill-posed but can still be solved if an independent criterion for “good focus” is available againstwhich the success of the solution can be evaluated. In such so-called blind deconvolution schemes a

  • Remote Sens. 2020, 12, 176 4 of 15

    systemic search based on, for example, a genetic algorithm (GM) [10], can be conducted to identify thecombination of deblurred images and uniform PSFs that best reproduces the recorded blurred image.Solutions obtained in this way are generally not unique but may still be useful. A viable alternativewhich assures stability and uniqueness is regularization [11]. Machine learning (ML) approaches toimage deblurring have inevitably emerged, mostly in the context of improving PSF estimates [12–16].

    Figure 4 is a scale drawing of a cross-section of a wide-field-angle Ritchey-Chrétien telescope (RCT)consisting of a field-limiting forward baffle, a baffled hyperbolic primary mirror, a baffled hyperbolicsecondary mirror, and a plane readout array. A high-fidelity Monte Carlo Ray-Trace (MCRT) model ofthis instrument forms the basis for the current investigation. Ashraf et al. [17] have previously reporteda novel approach to scene recovery by this instrument. In their previous approach a mean scenedirection was computed for the rays absorbed on a given pixel of the readout array during simulatedobservation of a blackbody calibration source. A pixel-by-pixel calibration curve was then establishedby computing the corresponding absorbed power distribution on the readout array. This approachwas shown to work well for the limited amount of testing to which it has been subjected.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 4 of 16

    uniform PSFs that best reproduces the recorded blurred image. Solutions obtained in this way are generally not unique but may still be useful. A viable alternative which assures stability and uniqueness is regularization [11]. Machine learning (ML) approaches to image deblurring have inevitably emerged, mostly in the context of improving PSF estimates [12–16].

    Figure 4 is a scale drawing of a cross-section of a wide-field-angle Ritchey-Chrétien telescope (RCT) consisting of a field-limiting forward baffle, a baffled hyperbolic primary mirror, a baffled hyperbolic secondary mirror, and a plane readout array. A high-fidelity Monte Carlo Ray-Trace (MCRT) model of this instrument forms the basis for the current investigation. Ashraf et al. [17] have previously reported a novel approach to scene recovery by this instrument. In their previous approach a mean scene direction was computed for the rays absorbed on a given pixel of the readout array during simulated observation of a blackbody calibration source. A pixel-by-pixel calibration curve was then established by computing the corresponding absorbed power distribution on the readout array. This approach was shown to work well for the limited amount of testing to which it has been subjected.

    Figure 4. Cross-section of the wide-field-angle Ritchey-Chrétien telescope (RCT) which is the basis of the current investigation.

    The technique presented in the current contribution is similar to one described in Ref. [18], with the important difference that the authors of the cited reference start with a discretized well-focused image to which they add known mathematical noise and blurring. This is in contrast to our approach in which:

    (1) The readout array power distribution, which is the input to the ANN model, is produced by introducing a randomly discretized scene to the high-fidelity MCRT optical model of the imaging system, and

    (2) The readout array does not have the same number of pixels as the output of the ANN model, which represents the recovered discretized scene.

    Rather than recording a replicate of the scene, the readout array is required only to record sufficient information to recover the original scene. Thus, our method is fundamentally different from the previous deblurring paradigms based on the solution of Equation (1). Instead, an artificial neural network (ANN) is used to characterize the relationship between the illumination pattern on the readout array and the corresponding discretized scene that produced it. The MCRT-based high-

    Readout Plane

    Figure 4. Cross-section of the wide-field-angle Ritchey-Chrétien telescope (RCT) which is the basis ofthe current investigation.

    The technique presented in the current contribution is similar to one described in Ref. [18], withthe important difference that the authors of the cited reference start with a discretized well-focusedimage to which they add known mathematical noise and blurring. This is in contrast to our approachin which:

    (1) The readout array power distribution, which is the input to the ANN model, is produced byintroducing a randomly discretized scene to the high-fidelity MCRT optical model of the imagingsystem, and

    (2) The readout array does not have the same number of pixels as the output of the ANN model,which represents the recovered discretized scene.

    Rather than recording a replicate of the scene, the readout array is required only to record sufficientinformation to recover the original scene. Thus, our method is fundamentally different from theprevious deblurring paradigms based on the solution of Equation (1). Instead, an artificial neuralnetwork (ANN) is used to characterize the relationship between the illumination pattern on the readoutarray and the corresponding discretized scene that produced it. The MCRT-based high-fidelity model

  • Remote Sens. 2020, 12, 176 5 of 15

    (HFM) of the imager is used to train the ANN by presenting it with a large number of pairs of readoutarray power distributions and corresponding discretized scene intensity distributions. Once trained,the ANN may then be used to predict the discretized scene corresponding to any recorded readoutarray power distribution. The logic flow of the technique is illustrated in Figure 5.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 5 of 16

    fidelity model (HFM) of the imager is used to train the ANN by presenting it with a large number of pairs of readout array power distributions and corresponding discretized scene intensity distributions. Once trained, the ANN may then be used to predict the discretized scene corresponding to any recorded readout array power distribution. The logic flow of the technique is illustrated in Figure 5.

    Figure 5. Numerical focusing logic block diagram.

    Step 1. Creation of Scene/Readout array Pairs

    Block 1 in Figure 5 indicates a process in which scenes are synthesized as a collection of random-strength beams incident from a discrete set of directions. Each beam, representing light from a point source at infinity, consists of a large number of parallel rays that flood the entrance aperture of the high-fidelity Monte Carlo Ray-Trace (MCRT) imager model of the telescope shown in Figure 4 and represented by Block 2 in Figure 5. Details of the imager model are similar to those elaborated in Chapter 3 (pp. 85–94) of Ref. [19]. Block 3 records the output of the imager high-fidelity model (HFM) on a plane two-dimensional 19 × 19-pixel readout array. During Step 1, 2000 random-strength beams incident from 50 specified directions are input to the imager HFM, producing 2000 corresponding power distributions on the readout array.

    Step 2. Training the Artificial Neural Network (ANN)

    A random selection of 1950 of the 2000 readout array power distributions created in Step 1 and loaded into Block 3 are input one at a time into the artificial neural network represented by Block 4. For each of these readout array power distributions, the synaptic weights of the ANN are adjusted in an iterative process, described in Section 4, which minimizes the difference between the ANN output scene represented by Block 5 and the corresponding target scene in Block 1.

    Step 3. Testing the Artificial Neural Network

    The 50 readout array power distributions created in Step 1 that were not used to train the ANN in Step 2 are introduced sequentially into the trained ANN. Then the resulting output scene (Block 5) in each case is compared to the target scene (Block 1) used to create it. The pixel-by-pixel differences between corresponding ANN output and target scenes are a measure of the success of the proposed numerical focusing scheme.

    Discretized Scene, L (ϑi, ϕi)

    Hi-Fi MCRT Optical Model

    Readout Array P (xj, yj)

    ANN Input

    Artificial Neural Network

    Target Recovered Scene, L *(ϑi, ϕi)

    ANN Output

    1

    2

    3 4

    5

    Comparison

    Figure 5. Numerical focusing logic block diagram.

    Step 1. Creation of Scene/Readout array Pairs

    Block 1 in Figure 5 indicates a process in which scenes are synthesized as a collection ofrandom-strength beams incident from a discrete set of directions. Each beam, representing light from apoint source at infinity, consists of a large number of parallel rays that flood the entrance aperture ofthe high-fidelity Monte Carlo Ray-Trace (MCRT) imager model of the telescope shown in Figure 4and represented by Block 2 in Figure 5. Details of the imager model are similar to those elaborated inChapter 3 (pp. 85–94) of Ref. [19]. Block 3 records the output of the imager high-fidelity model (HFM)on a plane two-dimensional 19 × 19-pixel readout array. During Step 1, 2000 random-strength beamsincident from 50 specified directions are input to the imager HFM, producing 2000 correspondingpower distributions on the readout array.

    Step 2. Training the Artificial Neural Network (ANN)

    A random selection of 1950 of the 2000 readout array power distributions created in Step 1 andloaded into Block 3 are input one at a time into the artificial neural network represented by Block 4.For each of these readout array power distributions, the synaptic weights of the ANN are adjusted inan iterative process, described in Section 4, which minimizes the difference between the ANN outputscene represented by Block 5 and the corresponding target scene in Block 1.

    Step 3. Testing the Artificial Neural Network

    The 50 readout array power distributions created in Step 1 that were not used to train the ANN inStep 2 are introduced sequentially into the trained ANN. Then the resulting output scene (Block 5) ineach case is compared to the target scene (Block 1) used to create it. The pixel-by-pixel differencesbetween corresponding ANN output and target scenes are a measure of the success of the proposednumerical focusing scheme.

  • Remote Sens. 2020, 12, 176 6 of 15

    Step 4. Prediction of unknown scenes from recorded readout array power distributions

    Availability of a properly trained and tested ANN model of the imager renders further raytracing unnecessary. From this point forward, the trained ANN model can be reliably used to convertrecorded readout array power distributions to corresponding discretized scenes by following the pathBlock 3→Block 4→Block 5. Alternatively, the operational instrument, once built, can be calibrated byintroducing discrete beams from collimated sources incident from directions corresponding to thedesired directional resolution. Preliminary versions of the ANN model can be used in the design phaseof instrument development, while higher-order, more refined models can be used to yield scientificallyaccurate science data during on-orbit operation of the actual imager.

    Details of the individual steps are provided in Sections 3–5.

    3. Instrument Model

    The specific Ritchey-Chrétien telescope (RCT) which informs the current investigation is shown inFigure 4. The three ray-traces shown indicate that beams entering at different field angles achieve focuson a curved surface (the dashed curve). Therefore, the PSF of a beam on the plane readout array willbe increasingly misfocused with increasing incidence angle. While the results reported in the currentinvestigation are specific to this particular optical system, the methodology used to obtain them isgeneral and therefore applicable to virtually any optical system for which a high-fidelity performancemodel is available.

    A Monte Carlo ray-trace [19] is performed in which millions of rays are traced from each of50 directions to form beams, each flooding the entrance aperture of the telescope shown in Figure 4.Following Ashraf [20], the 50 directions are determined by first dividing an imaginary hemispheresurmounting the entrance aperture into equal-area sectors. Then the rays forming a given beam areconstrained to pass parallel to a ray which passes normal to the centroid of one of the sectors. The raysare traced through the baffled telescope and eventually absorbed on a 361-pixel two-dimensionalmicrobolometer array. Results of a ray-trace for a one-million-ray beam incident to the aperture ata zenith angle ϑ of 10.9 deg and an azimuth angle φ of 18.0 deg are shown in Figure 6, and resultsfor all 50 beams showing the distribution of absorbed power from each of the 50 directions on the19-by-19-element array are given in Figure 7. Each incident beam direction is assigned a numberranging from 1 to 50. Assigned beam numbers are indicated in red type. In Figures 6 and 7, the red endof the color spectrum represents the largest number of rays absorbed by a pixel for a given direction,and the yellow end of the spectrum represents the smallest nonzero number of absorbed rays, withgreen indicating zero rays. Creation of the fifty “primitives” shown in Figure 7 required about 250 minof machine time on a laptop PC.

    It is clear from inspection of Figure 6 that power from beams incident from a given direction isabsorbed by several neighboring pixels. The distribution becomes increasingly distorted moving fromϑ = 10.9 to ϑ = 33.1 deg for a given value of ϕ. Also, the number of rays in the original beam that reachthe readout plane decreases with zenith angle.

  • Remote Sens. 2020, 12, 176 7 of 15

    Remote Sens. 2020, 12, x FOR PEER REVIEW 7 of 16

    Figure 6. Distribution on the 19-by-19 microbolometer array of collimated rays forming Beam 1 in Figure 7.

    Figure 7. Distributions on the readout plane of rays incident to the instrument aperture from 50 directions.

    It is clear from inspection of Figure 6 that power from beams incident from a given direction is absorbed by several neighboring pixels. The distribution becomes increasingly distorted moving from 𝜗 = 10.9 to 𝜗 = 33.1 deg for a given value of 𝜑. Also, the number of rays in the original beam that reach the readout plane decreases with zenith angle.

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 447 51085 10274 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 13124 1E+05 2E+05 49642 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 12815 70177 90766 1E+05 25271 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    x-Pixel Positions

    y-Pi

    xel P

    ositi

    ons

    1.0

    0.9

    0.8

    0.7

    0.6

    0.5

    0.4

    0.3

    0.2

    0.1

    0.0

    2.0E+05

    Figure 6. Distribution on the 19-by-19 microbolometer array of collimated rays forming Beam 1 inFigure 7.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 7 of 16

    Figure 6. Distribution on the 19-by-19 microbolometer array of collimated rays forming Beam 1 in Figure 7.

    Figure 7. Distributions on the readout plane of rays incident to the instrument aperture from 50 directions.

    It is clear from inspection of Figure 6 that power from beams incident from a given direction is absorbed by several neighboring pixels. The distribution becomes increasingly distorted moving from 𝜗 = 10.9 to 𝜗 = 33.1 deg for a given value of 𝜑. Also, the number of rays in the original beam that reach the readout plane decreases with zenith angle.

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 447 51085 10274 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 13124 1E+05 2E+05 49642 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 12815 70177 90766 1E+05 25271 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

    x-Pixel Positions

    y-Pi

    xel P

    ositi

    ons

    1.0

    0.9

    0.8

    0.7

    0.6

    0.5

    0.4

    0.3

    0.2

    0.1

    0.0

    2.0E+05

    Figure 7. Distributions on the readout plane of rays incident to the instrument aperture from50 directions.

    4. The Artificial Neural Network

    An artificial neural network (ANN) is an information-processing paradigm inspired by thebiological neuron system found in the human brain. It consists of a large number of simple processingelements called neurons, or nodes, organized in layers, as illustrated in Figure 8. In a fully-connected

  • Remote Sens. 2020, 12, 176 8 of 15

    ANN, all nodes of each hidden layer communicate with all nodes of the previous and following layersby means of synaptic connectors. Each connector is characterized by a synaptic weight. The values inthe output layer characterize the response of the system to the values in the input layer. In the currentapplication the input layer consists of 361 nodes describing the power distribution on the readoutarray, and the output layer consists of 50 nodes describing the corresponding intensities of the beamsincident to the instrument aperture. While the configuration shown in Figure 8 illustrates a 3-nodeinput layer, two 6-node hidden layers, and a 2-node output layer; the ANN created for the currentapplication features a 361-node input layer, two 100-node hidden layers, and a 50-node output layer.

    Remote Sens. 2020, 12, x FOR PEER REVIEW 8 of 16

    4. The Artificial Neural Network

    An artificial neural network (ANN) is an information-processing paradigm inspired by the biological neuron system found in the human brain. It consists of a large number of simple processing elements called neurons, or nodes, organized in layers, as illustrated in Figure 8. In a fully-connected ANN, all nodes of each hidden layer communicate with all nodes of the previous and following layers by means of synaptic connectors. Each connector is characterized by a synaptic weight. The values in the output layer characterize the response of the system to the values in the input layer. In the current application the input layer consists of 361 nodes describing the power distribution on the readout array, and the output layer consists of 50 nodes describing the corresponding intensities of the beams incident to the instrument aperture. While the configuration shown in Figure 8 illustrates a 3-node input layer, two 6-node hidden layers, and a 2-node output layer; the ANN created for the current application features a 361-node input layer, two 100-node hidden layers, and a 50-node output layer.

    Figure 8. A 3-6-6-2 artificial neural network (ANN) consisting of a 3-node input layer, two 6-node hidden layers, and a 2-node output layer.

    The synaptic weights determine the relative importance of the signals from all the nodes in the previous layer. At each hidden-layer node, the node input consists of a sum of all the outputs of the nodes in the previous layer, each modified by an individual interconnector weight. At each hidden node, the node output is determined by an appropriate activation function, which performs nonlinear input-output transformations. The information treated by the connector and node operations is introduced at the input layer, and this propagates forward toward the output layer [21]. Such ANNs are known as feed-forward networks, which is the type used in the current study.

    The output layer error can be determined by direct comparison between the recovered scene (Block 5 in Figure 4) and the target discretized scene (Block 1 in Figure 4). Training of the ANN adjusts its synaptic weights to minimize the errors between these two images. The training procedure for feed-forward networks is known as the supervised back propagation (BP) learning scheme, where the weights and biases are adjusted layer by layer from the output layer toward the input layer [22]. The mathematical basis, the procedures for training and testing the ANNs, and a fuller description of the BP algorithm can be found elsewhere [23].

    Overfitting may occur because of an overly complex model with too many parameters. A model that is overfitted is inaccurate because the trend does not reflect the reality present in the data. The presence of overfitting can be revealed if the model produces good results on the seen data (training set) but performs poorly on the unseen data (test set). This is a very important consideration since we want our model to make predictions based on the data that it has never seen before. Therefore, in the current application, additional structured test scenes were introduced involving data completely

    2-Node Output Layer

    Two 6-Node Hidden Layers

    3-Node Input Layer

    Figure 8. A 3-6-6-2 artificial neural network (ANN) consisting of a 3-node input layer, two 6-nodehidden layers, and a 2-node output layer.

    The synaptic weights determine the relative importance of the signals from all the nodes inthe previous layer. At each hidden-layer node, the node input consists of a sum of all the outputsof the nodes in the previous layer, each modified by an individual interconnector weight. At eachhidden node, the node output is determined by an appropriate activation function, which performsnonlinear input-output transformations. The information treated by the connector and node operationsis introduced at the input layer, and this propagates forward toward the output layer [21]. Such ANNsare known as feed-forward networks, which is the type used in the current study.

    The output layer error can be determined by direct comparison between the recovered scene(Block 5 in Figure 4) and the target discretized scene (Block 1 in Figure 4). Training of the ANN adjustsits synaptic weights to minimize the errors between these two images. The training procedure forfeed-forward networks is known as the supervised back propagation (BP) learning scheme, wherethe weights and biases are adjusted layer by layer from the output layer toward the input layer [22].The mathematical basis, the procedures for training and testing the ANNs, and a fuller description ofthe BP algorithm can be found elsewhere [23].

    Overfitting may occur because of an overly complex model with too many parameters. A modelthat is overfitted is inaccurate because the trend does not reflect the reality present in the data.The presence of overfitting can be revealed if the model produces good results on the seen data(training set) but performs poorly on the unseen data (test set). This is a very important considerationsince we want our model to make predictions based on the data that it has never seen before. Therefore,in the current application, additional structured test scenes were introduced involving data completelyunknown to the ANN training process. As shown in Section 5, the trained model performed extremelywell on them. We take this as an indication that we do not have the problem of overfitting in ourmodel and that it can generalize well from the training data to any data from the problem domain.

  • Remote Sens. 2020, 12, 176 9 of 15

    Techniques such as early stopping, data augmentation, regularization, and drop-out are available toovercome this problem if detected.

    An Adam optimization algorithm is used in the present study to converge the ANN output withthe target scenes during the training process. This stochastic optimization method is straightforwardto implement, is computationally efficient, has little memory requirements, is invariant to diagonalrescaling of the gradients, and is well suited for problems that are large in terms of data. Further detailsabout Adam optimization can be found in Ref. [24].

    Mean-squared error (MSE) is used as the objective loss function for the ANN optimization.An inherent weakness of the BP algorithm is that it can converge to a local minimum. One way toavoid this tendency is to change the learning rate during the network training process. “Learning rate”refers to the rate of change of the neural network weights during optimization. The learning ratewas ultimately set to 0.0002. Training of the neural network is terminated when a predeterminedmaximum number of training cycles have been completed. Selection of the maximum number is atrial-and-error process in which the number may be changed if the performance of the neural networkduring initial training falls short of expectations. In the current study 40,000 iterations were found toproduce good results.

    The relative error of predicted output i is defined by

    REi =

    ∣∣∣targeti − outputi∣∣∣targeti

    , (3)

    where outputi is the scene intensity predicted by the ANN, and targeti is the corresponding knownscene intensity. In the current investigation, performance is evaluated by calculating the mean value ofthe relative error,

    MRE =1n

    n∑i=1

    REi, (4)

    where n = 50 for the predicted 50 incident directions in the scene.An a priori selection of ANN hyperparameters such as network topology, training algorithm,

    and network size is usually made based on experience. After training, the final sets of weights andbiases trained by the network can be used for prediction purposes, and the corresponding ANNbecomes a model of the input/output relation of the given problem.

    5. Implementation and Results

    We create 2000 discretized scenes by combining the 50 primitive beam illumination patternsin Figure 7 after first multiplying each of them by a random scaling factor representing the relativescene intensity corresponding to each direction. This produces a set of 2000 readout array powerdistributions corresponding to the 2000 scenes viewed by the instrument. Figure 9a shows a typicalscene intensity distribution and Figure 9b shows the corresponding distribution of rays on the readoutarray. Even though the ray distribution in Figure 9b is produced by the single random scene inFigure 9a, essential features of the optical system are already readily apparent.

    We randomly select 1950 of the 2000 readout array/incident-scene pairs to train the ANN. Each ofthe 1950 361-pixel readout array power distributions is input to the ANN with the goal of reproducingthe target 50-element scene. The training process uses the optimization algorithm outlined in Section 4to automatically adjust the synaptic weights of the ANN to minimize the global difference betweenthe 1950 target scene intensity distributions and the 1950 scene intensity distributions returned by theANN. It is emphasized that the ANN is used to solve the inverse problem directly based on the dataobtained from the solution of the forward problem using a high-fidelity MCRT model.

  • Remote Sens. 2020, 12, 176 10 of 15Remote Sens. 2020, 12, x FOR PEER REVIEW 10 of 16

    Figure 9. (a) A typical scene power distribution over 50 directions, and (b) the corresponding distribution of rays on the readout array.

    We first test the ANN (i.e., establish its accuracy) by introducing the 50 sets of readout array power distributions not already used for training into the trained ANN to produce 50 test scenes. We then compare the test scenes created by the ANN with the corresponding target scenes. Figure 10 uses color variations to represent the fifty test “Earth” scenes and the corresponding scenes obtained using the ANN. In the figure, the red end of the color spectrum represents higher intensity and the green end represents lower intensity. While the similarity between Figure 10a and b is evident, with many red and green groupings being clearly identifiable in both, it is also possible to visually discern differences.

    y-Pi

    xel N

    umbe

    r x-Pixel Number

    104 rays Num

    ber o

    f Ray

    s in

    Bea

    m

    10─

    2

    (a) (b)

    Beam Direction Number

    18

    16

    14 12

    10

    8

    6

    4

    2 0

    Figure 9. (a) A typical scene power distribution over 50 directions, and (b) the correspondingdistribution of rays on the readout array.

    We first test the ANN (i.e., establish its accuracy) by introducing the 50 sets of readout array powerdistributions not already used for training into the trained ANN to produce 50 test scenes. We thencompare the test scenes created by the ANN with the corresponding target scenes. Figure 10 uses colorvariations to represent the fifty test “Earth” scenes and the corresponding scenes obtained using theANN. In the figure, the red end of the color spectrum represents higher intensity and the green endrepresents lower intensity. While the similarity between Figure 10a and b is evident, with many redand green groupings being clearly identifiable in both, it is also possible to visually discern differences.

    Figure 11 shows the direction-by-direction percentage difference in the scenes in Figure 10a,b.In the figure, the green cells indicate percentage differences of less than ±1.0%, and the pink cellsindicate differences of greater than ±1.0%. Although the font size in the figure makes individualnumbers difficult if not impossible to read, most of the pink cells in the left-hand third of the figureshow values of less than two percent, while a few of the pink cells in the right-hand third showvalues exceeding 100 percent. The left-to-right degradation of the ANN scene-recovery accuracy isattributable to the declining signal strength with increasing beam number. This conclusion is justifiedby reference to Figure 9b, which clearly shows the roll-off of absorbed power with distance from thecenter of the readout array, and to Figure 7, which shows that Beams 41 through 50 are responsible forilluminating the outer edges of the array.

    The randomness and unordered sequencing of the 50 scenes used to produce Figures 10 and 11make it difficult to visually assess the remarkable potential of numerical focusing based on artificialneural networks. A clearer demonstration of its potential is obtained based on the ordered sequenceof fifty scenes shown in Figure 12a. In the figure each of the fifty scenes, or horizontal strips, can bethought of as emanating from a swath of the earth that might correspond to an appropriate number ofsuccessive RBI scans illustrated in Figure 1. Figure 12a would then be the result obtained by assemblingthe fifty RBI-like footprints into an earth-emitted or earth-reflected solar image of a region of a notionalEarth. Figure 12b is the assembled sequence of 50 scenes produced by the ANN when the 50 readoutarray power distributions corresponding to the 50 scenes in Figure 12a are input to the ANN.

  • Remote Sens. 2020, 12, 176 11 of 15Remote Sens. 2020, 12, x FOR PEER REVIEW 11 of 16

    Figure 10. Each row represents (a) a random relative intensity distribution incident to the entrance aperture from 50 directions and (b) the corresponding directional relative intensity distribution produced by the ANN.

    Figure 11 shows the direction-by-direction percentage difference in the scenes in Figure 10a,b. In the figure, the green cells indicate percentage differences of less than ±1.0%, and the pink cells indicate differences of greater than ±1.0%. Although the font size in the figure makes individual numbers difficult if not impossible to read, most of the pink cells in the left-hand third of the figure show values of less than two percent, while a few of the pink cells in the right-hand third show values exceeding 100 percent. The left-to-right degradation of the ANN scene-recovery accuracy is attributable to the declining signal strength with increasing beam number. This conclusion is justified by reference to Figure 9b, which clearly shows the roll-off of absorbed power with distance from the center of the readout array, and to Figure 7, which shows that Beams 41 through 50 are responsible for illuminating the outer edges of the array.

    1.0

    0.9

    0.8

    0.7

    0.6

    0.5

    0.4

    0.3

    0.2

    0.1

    0.0

    a.u.

    Figure 10. Each row represents (a) a random relative intensity distribution incident to the entranceaperture from 50 directions and (b) the corresponding directional relative intensity distributionproduced by the ANN.

    The scene recovery error associated with a low signal-to-noise ratio in the final ten beam directionsis apparent in the right-most portion of Figure 12b. Otherwise the ability of the ANN numericalfocusing scheme to accurately recover the incident scene from the defocused readout array powerdistribution is well demonstrated. Figure 13 shows the direction-by-direction percentage difference inthe scenes in Figure 12a,b. In the figure, the green cells indicate percentage differences of less than±0.25%, and the pink cells indicate differences of greater than ±0.25%. The ability of the ANN toproduce results that are consistently within one-quarter of a percent of the actual scene when thescene is so dissimilar to the 2000 random scenes used for training and testing is evidence of stronggeneralization and a low likelihood of overfitting.

  • Remote Sens. 2020, 12, 176 12 of 15Remote Sens. 2020, 12, x FOR PEER REVIEW 12 of 16

    Figure 11. Map of the percentage differences between the two images shown in Figure 10. Green represents an error of within ±1.0%, and pink represents an error of greater than ±1.0%.

    The randomness and unordered sequencing of the 50 scenes used to produce Figures 10 and 11 make it difficult to visually assess the remarkable potential of numerical focusing based on artificial neural networks. A clearer demonstration of its potential is obtained based on the ordered sequence of fifty scenes shown in Figure 12a. In the figure each of the fifty scenes, or horizontal strips, can be thought of as emanating from a swath of the earth that might correspond to an appropriate number of successive RBI scans illustrated in Figure 1. Figure 12a would then be the result obtained by assembling the fifty RBI-like footprints into an earth-emitted or earth-reflected solar image of a region of a notional Earth. Figure 12b is the assembled sequence of 50 scenes produced by the ANN when the 50 readout array power distributions corresponding to the 50 scenes in Figure 12a are input to the ANN.

    The scene recovery error associated with a low signal-to-noise ratio in the final ten beam directions is apparent in the right-most portion of Figure 12b. Otherwise the ability of the ANN numerical focusing scheme to accurately recover the incident scene from the defocused readout array power distribution is well demonstrated. Figure 13 shows the direction-by-direction percentage difference in the scenes in Figure 12a,b. In the figure, the green cells indicate percentage differences of less than ±0.25%, and the pink cells indicate differences of greater than ±0.25%. The ability of the ANN to produce results that are consistently within one-quarter of a percent of the actual scene when the scene is so dissimilar to the 2000 random scenes used for training and testing is evidence of strong generalization and a low likelihood of overfitting.

    50 S

    ucce

    ssiv

    e Ea

    rth

    Scen

    e Re

    cove

    ry E

    rror

    s

    50 Beam Directions per Scene

    50 50

    1

    1

    Figure 11. Map of the percentage differences between the two images shown in Figure 10.Green represents an error of within ±1.0%, and pink represents an error of greater than ±1.0%.Remote Sens. 2020, 12, x FOR PEER REVIEW 13 of 16

    Figure 12. Two sets of 50 horizontal strips, each representing the relative beam power distribution incident to the instrument aperture from 50 directions. (a) Target scenes used to create the ANN input, and (b) the corresponding ANN output.

    Figure 13. Map of the percentage differences between the two images shown in Figure 12. Green cells indicate errors less than ±0.25 percent, pink cells indicate errors greater than ±0.25 percent.

    1.0

    0.9

    0.8

    0.7

    0.6

    0.5

    0.4

    0.3

    0.2

    0.1

    0.0

    50 S

    ucce

    ssiv

    e Sc

    enes

    1

    50

    50 S

    ucce

    ssiv

    e Sc

    enes

    1

    50 50 Beam Directions per Scene 1 50

    (a)

    (b)

    a.u.

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.072 -0.081 0.0508 -0.02 -0.008 0.0097 -0.028 0.0308 0.0615 -0.042 0.0765 0.1008 2E-05 -0.058 0.001 -0.018 -0.002 -0.019 -0.069 -0.016 0.0436 -0.111 -0.009 0.1787 -0.208 -0.005 -0.057 0.1607 -0.266 0.0732 -0.374 -0.182 -0.142 -0.14 -0.162 0.0955 0.0705 -0.065 0.095 -0.266 0.4761 -1.972 24.434 -1.203 -0.366 0.0994 -1.279 24.099 -0.95 -0.509

    -0.072 -0.081 0.0508 -0.02 -0.008 0.0097 -0.028 0.0308 0.0615 -0.042 0.0765 0.1008 2E-05 -0.058 0.001 -0.018 -0.002 -0.019 -0.069 -0.016 0.0436 -0.111 -0.009 0.1787 -0.208 -0.005 -0.057 0.1607 -0.266 0.0732 -0.374 -0.182 -0.142 -0.14 -0.162 0.0955 0.0705 -0.065 0.095 -0.266 0.4761 -1.972 24.434 -1.203 -0.366 0.0994 -1.279 24.099 -0.95 -0.509

    -0.07 -0.059 0.0374 -0.013 -0.02 0.0171 -0.046 0.0077 0.087 -0.028 0.0129 0.104 0.0689 -0.036 -0.014 0.0277 0.0144 0.0162 -0.08 0.0356 0.0039 -0.141 0.0277 0.0656 -0.233 0.0377 0.0329 0.0505 -0.143 0.0031 -0.327 -0.206 -0.132 -0.119 -0.109 0.0685 0.0654 -0.171 -0.031 -0.062 0.3512 -1.179 13.942 -0.698 -0.221 0.1274 -1.437 27.637 -1.18 -0.245

    -0.07 -0.059 0.0374 -0.013 -0.02 0.0171 -0.046 0.0077 0.087 -0.028 0.0129 0.104 0.0689 -0.036 -0.014 0.0277 0.0144 0.0162 -0.08 0.0356 0.0039 -0.141 0.0277 0.0656 -0.233 0.0377 0.0329 0.0505 -0.143 0.0031 -0.327 -0.206 -0.132 -0.119 -0.109 0.0685 0.0654 -0.171 -0.031 -0.062 0.3512 -1.179 13.942 -0.698 -0.221 0.1274 -1.437 27.637 -1.18 -0.245

    -0.073 -0.046 0.0221 0.0039 -0.022 0.004 -0.019 0.0019 0.0683 -0.025 0.023 0.0636 0.0664 -0.033 -0.021 0.0168 0.0143 0.0183 -0.022 0.0162 -0.02 -0.071 0.046 0.038 -0.212 0.0929 0.0543 0.0347 -0.082 -0.01 -0.042 -0.042 -0.117 -0.082 -0.133 0.0132 0.095 -0.067 -0.043 -0.067 0.3762 -1.353 16.767 -0.754 -0.213 0.1713 -0.85 15.845 -0.643 -0.132

    -0.073 -0.046 0.0221 0.0039 -0.022 0.004 -0.019 0.0019 0.0683 -0.025 0.023 0.0636 0.0664 -0.033 -0.021 0.0168 0.0143 0.0183 -0.022 0.0162 -0.02 -0.071 0.046 0.038 -0.212 0.0929 0.0543 0.0347 -0.082 -0.01 -0.042 -0.042 -0.117 -0.082 -0.133 0.0132 0.095 -0.067 -0.043 -0.067 0.3762 -1.353 16.767 -0.754 -0.213 0.1713 -0.85 15.845 -0.643 -0.132

    -0.088 -0.052 0.0406 0.0072 -0.03 0.0107 -0.026 0.0218 0.0572 -0.028 0.0296 0.0763 0.0227 -0.016 -0.026 -0.006 0.0094 0.0162 -0.021 0.0233 -0.011 -0.035 0.0371 0.0364 -0.246 0.0701 0.0443 0.0442 -0.107 -0.004 -0.045 -0.047 -0.154 -0.094 -0.191 0.099 0.1386 -0.036 -0.018 -0.178 0.4398 -1.991 25.522 -1.158 -0.299 0.187 -0.859 15.978 -0.59 -0.193

    -0.088 -0.052 0.0406 0.0072 -0.03 0.0107 -0.026 0.0218 0.0572 -0.028 0.0296 0.0763 0.0227 -0.016 -0.026 -0.006 0.0094 0.0162 -0.021 0.0233 -0.011 -0.035 0.0371 0.0364 -0.246 0.0701 0.0443 0.0442 -0.107 -0.004 -0.045 -0.047 -0.154 -0.094 -0.191 0.099 0.1386 -0.036 -0.018 -0.178 0.4398 -1.991 25.522 -1.158 -0.299 0.187 -0.859 15.978 -0.59 -0.193

    -0.088 -0.066 0.0453 0.0095 -0.028 0.013 -0.015 0.0287 0.0748 -0.028 0.0379 0.0619 0.0291 -0.021 -0.033 0.0069 0.0151 0.0106 -0.029 0.0259 -0.015 -0.032 0.0268 0.0487 -0.239 0.0411 0.0314 0.0404 -0.123 0.0139 -0.026 -0.071 -0.162 -0.074 -0.361 0.0661 0.0844 -0.035 -0.023 -0.214 0.4384 -2.048 26.227 -1.202 -0.351 0.1585 -0.881 15.487 -0.566 -0.194

    -0.088 -0.066 0.0453 0.0095 -0.028 0.013 -0.015 0.0287 0.0748 -0.028 0.0379 0.0619 0.0291 -0.021 -0.033 0.0069 0.0151 0.0106 -0.029 0.0259 -0.015 -0.032 0.0268 0.0487 -0.239 0.0411 0.0314 0.0404 -0.123 0.0139 -0.026 -0.071 -0.162 -0.074 -0.361 0.0661 0.0844 -0.035 -0.023 -0.214 0.4384 -2.048 26.227 -1.202 -0.351 0.1585 -0.881 15.487 -0.566 -0.194

    -0.061 -0.048 0.0213 -0.002 -0.018 0.005 -0.005 0.0135 0.0607 -0.027 0.0277 0.0407 0.0325 -0.016 -0.02 0.0328 0.0238 0.0105 -0.021 0.0178 -0.003 -0.03 0.0182 0.0281 -0.157 0.0565 0.0239 0.0213 -0.085 0.0171 -0.005 -0.06 -0.102 -0.106 -0.221 -0.005 0.0629 -0.03 -0.031 -0.096 0.2833 -1.236 15.559 -0.695 -0.211 0.1223 -0.578 9.8943 -0.34 -0.099

    -0.061 -0.048 0.0213 -0.002 -0.018 0.005 -0.005 0.0135 0.0607 -0.027 0.0277 0.0407 0.0325 -0.016 -0.02 0.0328 0.0238 0.0105 -0.021 0.0178 -0.003 -0.03 0.0182 0.0281 -0.157 0.0565 0.0239 0.0213 -0.085 0.0171 -0.005 -0.06 -0.102 -0.106 -0.221 -0.005 0.0629 -0.03 -0.031 -0.096 0.2833 -1.236 15.559 -0.695 -0.211 0.1223 -0.578 9.8943 -0.34 -0.099

    -0.065 -0.029 0.0241 0.0077 -0.023 0.0173 -0.022 0.004 0.0565 -0.024 0.0159 0.0565 0.0312 -0.014 -0.024 0.0164 0.0296 0.047 -0.016 0.0239 -0.009 -0.044 0.0393 0.011 -0.177 0.0736 0.0388 0.0142 -0.078 0.0134 -0.039 -0.031 -0.138 -0.088 -0.117 0.0459 0.0399 -0.033 -0.031 -0.048 0.2444 -0.874 10.472 -0.439 -0.157 0.1159 -0.642 12.674 -0.458 -0.061

    -0.065 -0.029 0.0241 0.0077 -0.023 0.0173 -0.022 0.004 0.0565 -0.024 0.0159 0.0565 0.0312 -0.014 -0.024 0.0164 0.0296 0.047 -0.016 0.0239 -0.009 -0.044 0.0393 0.011 -0.177 0.0736 0.0388 0.0142 -0.078 0.0134 -0.039 -0.031 -0.138 -0.088 -0.117 0.0459 0.0399 -0.033 -0.031 -0.048 0.2444 -0.874 10.472 -0.439 -0.157 0.1159 -0.642 12.674 -0.458 -0.061

    -0.07 -0.033 0.0413 0.0028 -0.03 0.0157 -0.025 0.0055 0.0504 -0.026 0.0284 0.0566 0.014 -0.028 -0.019 0.0008 0.0148 0.0168 -0.026 0.0216 0.0086 -0.043 0.0333 0.0384 -0.166 0.0405 0.0179 0.0245 -0.086 0.0225 -0.1 -0.055 -0.165 -0.081 -0.125 0.1073 0.0408 -0.043 0.0036 -0.072 0.3076 -1.104 12.949 -0.564 -0.214 0.0849 -0.839 16.524 -0.6 -0.178

    -0.07 -0.033 0.0413 0.0028 -0.03 0.0157 -0.025 0.0055 0.0504 -0.026 0.0284 0.0566 0.014 -0.028 -0.019 0.0008 0.0148 0.0168 -0.026 0.0216 0.0086 -0.043 0.0333 0.0384 -0.166 0.0405 0.0179 0.0245 -0.086 0.0225 -0.1 -0.055 -0.165 -0.081 -0.125 0.1073 0.0408 -0.043 0.0036 -0.072 0.3076 -1.104 12.949 -0.564 -0.214 0.0849 -0.839 16.524 -0.6 -0.178

    -0.058 -0.047 0.0418 -0.006 -0.022 0.0139 -0.029 0.0051 0.0554 -0.029 0.0167 0.0387 0.0099 -0.03 -0.019 0.0096 0.017 0.0046 -0.055 0.0512 0.0148 -0.078 0.0124 0.0606 -0.165 0.014 0.0093 0.0286 -0.098 0.0111 -0.209 -0.119 -0.099 -0.115 -0.104 0.0702 0.0443 -0.07 0.004 -0.06 0.2675 -1.053 12.427 -0.569 -0.216 0.1015 -0.952 18.129 -0.712 -0.199

    -0.058 -0.047 0.0418 -0.006 -0.022 0.0139 -0.029 0.0051 0.0554 -0.029 0.0167 0.0387 0.0099 -0.03 -0.019 0.0096 0.017 0.0046 -0.055 0.0512 0.0148 -0.078 0.0124 0.0606 -0.165 0.014 0.0093 0.0286 -0.098 0.0111 -0.209 -0.119 -0.099 -0.115 -0.104 0.0702 0.0443 -0.07 0.004 -0.06 0.2675 -1.053 12.427 -0.569 -0.216 0.1015 -0.952 18.129 -0.712 -0.199

    -0.055 -0.04 0.0276 0.008 -0.013 0.0141 -0.015 0.0103 0.0624 -0.023 0.0094 0.0428 0.0186 -0.022 -0.026 0.024 0.0173 0.011 -0.023 0.0372 -0.005 -0.056 0.0099 0.0325 -0.161 0.0616 0.0266 0.0134 -0.075 0.0091 -0.056 -0.059 -0.082 -0.068 -0.101 -0.006 0.0339 -0.054 -0.028 -0.028 0.1795 -0.901 10.876 -0.472 -0.159 0.1175 -0.649 11.869 -0.469 -0.081

    -0.058 -0.04 0.031 0.0081 -0.015 0.0093 -0.02 0.0166 0.0718 -0.017 0.014 0.0508 0.0162 -0.026 -0.031 0.0236 0.0207 0.01 -0.024 0.0491 -0.012 -0.056 0.0156 0.0666 -0.176 0.0688 0.0651 0.0019 -0.077 0.0143 -0.041 -0.062 -0.107 -0.065 -0.108 -0.008 0.0303 -0.065 -0.035 -0.069 0.2156 -1.081 13.242 -0.586 -0.215 0.1199 -0.706 12.913 -0.523 -0.102

    -0.067 -0.038 0.029 0.0079 -0.018 0.0039 -0.01 0.0175 0.0621 -0.024 0.0291 0.0523 0.0124 -0.039 -0.024 -7E-04 0.021 0.0027 -0.015 0.0059 0.0083 -0.013 0.0189 0.0711 -0.143 0.0708 0.0285 0.0064 -0.118 0.0518 -0.034 -0.045 -0.095 -0.049 -0.108 0.0188 0.0271 -0.033 -0.009 -0.089 0.2802 -1.218 15.067 -0.677 -0.221 0.1039 -0.591 10.884 -0.387 -0.179

    -0.054 -0.034 0.0275 0.0159 -0.017 0.0079 0.0014 0.0122 0.0463 -0.031 0.0168 0.0424 0.0165 -0.028 -0.014 -0.01 0.0132 0.0024 -0.007 -0.01 -0.004 0.0403 0.0105 0.0372 -0.063 0.0216 0.005 0.0128 -0.097 0.0296 -0.013 -0.046 -0.088 -0.043 -0.093 0.0191 0.0259 -0.003 0.0048 -0.092 0.2411 -1.132 14.287 -0.626 -0.187 0.1201 -0.331 5.9502 -0.157 -0.16

    -0.053 -0.045 0.0263 0.0155 -0.013 0.0161 -0.005 0.0101 0.0419 -0.04 0.0089 0.0459 0.0159 -0.024 0.0009 -0.021 0.0076 0.0012 -0.009 -0.011 -0.016 0.0145 0.0354 0.0428 -0.089 0.006 -0.004 0.0827 -0.135 0.0058 -0.027 -0.047 -0.099 -0.046 -0.119 0.059 0.0257 0.0052 0.0035 -0.118 0.3354 -1.445 18.278 -0.802 -0.243 0.1284 -0.402 8.0545 -0.255 -0.252

    -0.053 -0.045 0.0263 0.0155 -0.013 0.0161 -0.005 0.0101 0.0419 -0.04 0.0089 0.0459 0.0159 -0.024 0.0009 -0.021 0.0076 0.0012 -0.009 -0.011 -0.016 0.0145 0.0354 0.0428 -0.089 0.006 -0.004 0.0827 -0.135 0.0058 -0.027 -0.047 -0.099 -0.046 -0.119 0.059 0.0257 0.0052 0.0035 -0.118 0.3354 -1.445 18.278 -0.802 -0.243 0.1284 -0.402 8.0545 -0.255 -0.252

    -0.057 -0.036 0.0221 0.0178 -0.019 0.014 -0.009 0.0236 0.0611 -0.024 0.012 0.0655 0.0259 -0.009 -0.013 -0.007 0.0082 0.0077 -0.006 0.0073 -0.024 -0.006 0.0727 0.0338 -0.105 0.0251 0.0579 0.036 -0.077 -0.003 0.0204 -0.05 -0.14 -0.025 -0.137 0.0423 0.0301 -0.011 -0.031 -0.167 0.3447 -1.656 21.047 -0.911 -0.297 0.1279 -0.431 8.2874 -0.283 -0.174

    -0.057 -0.036 0.0221 0.0178 -0.019 0.014 -0.009 0.0236 0.0611 -0.024 0.012 0.0655 0.0259 -0.009 -0.013 -0.007 0.0082 0.0077 -0.006 0.0073 -0.024 -0.006 0.0727 0.0338 -0.105 0.0251 0.0579 0.036 -0.077 -0.003 0.0204 -0.05 -0.14 -0.025 -0.137 0.0423 0.0301 -0.011 -0.031 -0.167 0.3447 -1.656 21.047 -0.911 -0.297 0.1279 -0.431 8.2874 -0.283 -0.174

    -0.064 -0.033 0.0178 0.01 -0.024 0.0114 -0.017 0.0154 0.0745 -0.017 0.0185 0.0589 0.0274 -0.017 -0.031 0.0145 0.0204 0.0205 -0.019 0.0271 -0.012 -0.046 0.0397 0.0275 -0.18 0.0815 0.0943 -3E-04 -0.075 0.0052 0.0041 -0.044 -0.114 -0.03 -0.117 0.0214 0.03 -0.034 -0.041 -0.095 0.266 -1.158 14.249 -0.608 -0.217 0.1104 -0.638 11.906 -0.452 -0.071

    -0.064 -0.033 0.0178 0.01 -0.024 0.0114 -0.017 0.0154 0.0745 -0.017 0.0185 0.0589 0.0274 -0.017 -0.031 0.0145 0.0204 0.0205 -0.019 0.0271 -0.012 -0.046 0.0397 0.0275 -0.18 0.0815 0.0943 -3E-04 -0.075 0.0052 0.0041 -0.044 -0.114 -0.03 -0.117 0.0214 0.03 -0.034 -0.041 -0.095 0.266 -1.158 14.249 -0.608 -0.217 0.1104 -0.638 11.906 -0.452 -0.071

    -0.061 -0.033 0.0142 0.0098 -0.022 0.0162 -0.013 0.0092 0.0652 -0.022 0.014 0.0508 0.0297 -0.013 -0.026 0.015 0.017 0.0214 -0.017 0.0211 -0.009 -0.046 0.034 0.0129 -0.166 0.0741 0.0412 0.011 -0.072 0.0027 -0.003 -0.04 -0.089 -0.033 -0.11 0.0235 0.0336 -0.023 -0.034 -0.053 0.2298 -0.977 11.884 -0.494 -0.162 0.1082 -0.58 10.862 -0.398 -0.051

    -0.061 -0.033 0.0142 0.0098 -0.022 0.0162 -0.013 0.0092 0.0652 -0.022 0.014 0.0508 0.0297 -0.013 -0.026 0.015 0.017 0.0214 -0.017 0.0211 -0.009 -0.046 0.034 0.0129 -0.166 0.0741 0.0412 0.011 -0.072 0.0027 -0.003 -0.04 -0.089 -0.033 -0.11 0.0235 0.0336 -0.023 -0.034 -0.053 0.2298 -0.977 11.884 -0.494 -0.162 0.1082 -0.58 10.862 -0.398 -0.051

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0162 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.005 0.0127 0.0201 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.025 -0.044 -0.107 -0.025 -0.102 0.0219 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0162 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.005 0.0127 0.0201 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.025 -0.044 -0.107 -0.025 -0.102 0.0219 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    50 Beam Directions per Scene 1 50

    50 S

    ucce

    ssiv

    e Sc

    ene

    Reco

    very

    Err

    ors

    1

    50

    Figure 12. Two sets of 50 horizontal strips, each representing the relative beam power distributionincident to the instrument aperture from 50 directions. (a) Target scenes used to create the ANN input,and (b) the corresponding ANN output.

  • Remote Sens. 2020, 12, 176 13 of 15

    Remote Sens. 2020, 12, x FOR PEER REVIEW 13 of 16

    Figure 12. Two sets of 50 horizontal strips, each representing the relative beam power distribution incident to the instrument aperture from 50 directions. (a) Target scenes used to create the ANN input, and (b) the corresponding ANN output.

    Figure 13. Map of the percentage differences between the two images shown in Figure 12. Green cells indicate errors less than ±0.25 percent, pink cells indicate errors greater than ±0.25 percent.

    1.0

    0.9

    0.8

    0.7

    0.6

    0.5

    0.4

    0.3

    0.2

    0.1

    0.0

    50 S

    ucce

    ssiv

    e Sc

    enes

    1

    50

    50 S

    ucce

    ssiv

    e Sc

    enes

    1

    50 50 Beam Directions per Scene 1 50

    (a)

    (b)

    a.u.

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.072 -0.081 0.0508 -0.02 -0.008 0.0097 -0.028 0.0308 0.0615 -0.042 0.0765 0.1008 2E-05 -0.058 0.001 -0.018 -0.002 -0.019 -0.069 -0.016 0.0436 -0.111 -0.009 0.1787 -0.208 -0.005 -0.057 0.1607 -0.266 0.0732 -0.374 -0.182 -0.142 -0.14 -0.162 0.0955 0.0705 -0.065 0.095 -0.266 0.4761 -1.972 24.434 -1.203 -0.366 0.0994 -1.279 24.099 -0.95 -0.509

    -0.072 -0.081 0.0508 -0.02 -0.008 0.0097 -0.028 0.0308 0.0615 -0.042 0.0765 0.1008 2E-05 -0.058 0.001 -0.018 -0.002 -0.019 -0.069 -0.016 0.0436 -0.111 -0.009 0.1787 -0.208 -0.005 -0.057 0.1607 -0.266 0.0732 -0.374 -0.182 -0.142 -0.14 -0.162 0.0955 0.0705 -0.065 0.095 -0.266 0.4761 -1.972 24.434 -1.203 -0.366 0.0994 -1.279 24.099 -0.95 -0.509

    -0.07 -0.059 0.0374 -0.013 -0.02 0.0171 -0.046 0.0077 0.087 -0.028 0.0129 0.104 0.0689 -0.036 -0.014 0.0277 0.0144 0.0162 -0.08 0.0356 0.0039 -0.141 0.0277 0.0656 -0.233 0.0377 0.0329 0.0505 -0.143 0.0031 -0.327 -0.206 -0.132 -0.119 -0.109 0.0685 0.0654 -0.171 -0.031 -0.062 0.3512 -1.179 13.942 -0.698 -0.221 0.1274 -1.437 27.637 -1.18 -0.245

    -0.07 -0.059 0.0374 -0.013 -0.02 0.0171 -0.046 0.0077 0.087 -0.028 0.0129 0.104 0.0689 -0.036 -0.014 0.0277 0.0144 0.0162 -0.08 0.0356 0.0039 -0.141 0.0277 0.0656 -0.233 0.0377 0.0329 0.0505 -0.143 0.0031 -0.327 -0.206 -0.132 -0.119 -0.109 0.0685 0.0654 -0.171 -0.031 -0.062 0.3512 -1.179 13.942 -0.698 -0.221 0.1274 -1.437 27.637 -1.18 -0.245

    -0.073 -0.046 0.0221 0.0039 -0.022 0.004 -0.019 0.0019 0.0683 -0.025 0.023 0.0636 0.0664 -0.033 -0.021 0.0168 0.0143 0.0183 -0.022 0.0162 -0.02 -0.071 0.046 0.038 -0.212 0.0929 0.0543 0.0347 -0.082 -0.01 -0.042 -0.042 -0.117 -0.082 -0.133 0.0132 0.095 -0.067 -0.043 -0.067 0.3762 -1.353 16.767 -0.754 -0.213 0.1713 -0.85 15.845 -0.643 -0.132

    -0.073 -0.046 0.0221 0.0039 -0.022 0.004 -0.019 0.0019 0.0683 -0.025 0.023 0.0636 0.0664 -0.033 -0.021 0.0168 0.0143 0.0183 -0.022 0.0162 -0.02 -0.071 0.046 0.038 -0.212 0.0929 0.0543 0.0347 -0.082 -0.01 -0.042 -0.042 -0.117 -0.082 -0.133 0.0132 0.095 -0.067 -0.043 -0.067 0.3762 -1.353 16.767 -0.754 -0.213 0.1713 -0.85 15.845 -0.643 -0.132

    -0.088 -0.052 0.0406 0.0072 -0.03 0.0107 -0.026 0.0218 0.0572 -0.028 0.0296 0.0763 0.0227 -0.016 -0.026 -0.006 0.0094 0.0162 -0.021 0.0233 -0.011 -0.035 0.0371 0.0364 -0.246 0.0701 0.0443 0.0442 -0.107 -0.004 -0.045 -0.047 -0.154 -0.094 -0.191 0.099 0.1386 -0.036 -0.018 -0.178 0.4398 -1.991 25.522 -1.158 -0.299 0.187 -0.859 15.978 -0.59 -0.193

    -0.088 -0.052 0.0406 0.0072 -0.03 0.0107 -0.026 0.0218 0.0572 -0.028 0.0296 0.0763 0.0227 -0.016 -0.026 -0.006 0.0094 0.0162 -0.021 0.0233 -0.011 -0.035 0.0371 0.0364 -0.246 0.0701 0.0443 0.0442 -0.107 -0.004 -0.045 -0.047 -0.154 -0.094 -0.191 0.099 0.1386 -0.036 -0.018 -0.178 0.4398 -1.991 25.522 -1.158 -0.299 0.187 -0.859 15.978 -0.59 -0.193

    -0.088 -0.066 0.0453 0.0095 -0.028 0.013 -0.015 0.0287 0.0748 -0.028 0.0379 0.0619 0.0291 -0.021 -0.033 0.0069 0.0151 0.0106 -0.029 0.0259 -0.015 -0.032 0.0268 0.0487 -0.239 0.0411 0.0314 0.0404 -0.123 0.0139 -0.026 -0.071 -0.162 -0.074 -0.361 0.0661 0.0844 -0.035 -0.023 -0.214 0.4384 -2.048 26.227 -1.202 -0.351 0.1585 -0.881 15.487 -0.566 -0.194

    -0.088 -0.066 0.0453 0.0095 -0.028 0.013 -0.015 0.0287 0.0748 -0.028 0.0379 0.0619 0.0291 -0.021 -0.033 0.0069 0.0151 0.0106 -0.029 0.0259 -0.015 -0.032 0.0268 0.0487 -0.239 0.0411 0.0314 0.0404 -0.123 0.0139 -0.026 -0.071 -0.162 -0.074 -0.361 0.0661 0.0844 -0.035 -0.023 -0.214 0.4384 -2.048 26.227 -1.202 -0.351 0.1585 -0.881 15.487 -0.566 -0.194

    -0.061 -0.048 0.0213 -0.002 -0.018 0.005 -0.005 0.0135 0.0607 -0.027 0.0277 0.0407 0.0325 -0.016 -0.02 0.0328 0.0238 0.0105 -0.021 0.0178 -0.003 -0.03 0.0182 0.0281 -0.157 0.0565 0.0239 0.0213 -0.085 0.0171 -0.005 -0.06 -0.102 -0.106 -0.221 -0.005 0.0629 -0.03 -0.031 -0.096 0.2833 -1.236 15.559 -0.695 -0.211 0.1223 -0.578 9.8943 -0.34 -0.099

    -0.061 -0.048 0.0213 -0.002 -0.018 0.005 -0.005 0.0135 0.0607 -0.027 0.0277 0.0407 0.0325 -0.016 -0.02 0.0328 0.0238 0.0105 -0.021 0.0178 -0.003 -0.03 0.0182 0.0281 -0.157 0.0565 0.0239 0.0213 -0.085 0.0171 -0.005 -0.06 -0.102 -0.106 -0.221 -0.005 0.0629 -0.03 -0.031 -0.096 0.2833 -1.236 15.559 -0.695 -0.211 0.1223 -0.578 9.8943 -0.34 -0.099

    -0.065 -0.029 0.0241 0.0077 -0.023 0.0173 -0.022 0.004 0.0565 -0.024 0.0159 0.0565 0.0312 -0.014 -0.024 0.0164 0.0296 0.047 -0.016 0.0239 -0.009 -0.044 0.0393 0.011 -0.177 0.0736 0.0388 0.0142 -0.078 0.0134 -0.039 -0.031 -0.138 -0.088 -0.117 0.0459 0.0399 -0.033 -0.031 -0.048 0.2444 -0.874 10.472 -0.439 -0.157 0.1159 -0.642 12.674 -0.458 -0.061

    -0.065 -0.029 0.0241 0.0077 -0.023 0.0173 -0.022 0.004 0.0565 -0.024 0.0159 0.0565 0.0312 -0.014 -0.024 0.0164 0.0296 0.047 -0.016 0.0239 -0.009 -0.044 0.0393 0.011 -0.177 0.0736 0.0388 0.0142 -0.078 0.0134 -0.039 -0.031 -0.138 -0.088 -0.117 0.0459 0.0399 -0.033 -0.031 -0.048 0.2444 -0.874 10.472 -0.439 -0.157 0.1159 -0.642 12.674 -0.458 -0.061

    -0.07 -0.033 0.0413 0.0028 -0.03 0.0157 -0.025 0.0055 0.0504 -0.026 0.0284 0.0566 0.014 -0.028 -0.019 0.0008 0.0148 0.0168 -0.026 0.0216 0.0086 -0.043 0.0333 0.0384 -0.166 0.0405 0.0179 0.0245 -0.086 0.0225 -0.1 -0.055 -0.165 -0.081 -0.125 0.1073 0.0408 -0.043 0.0036 -0.072 0.3076 -1.104 12.949 -0.564 -0.214 0.0849 -0.839 16.524 -0.6 -0.178

    -0.07 -0.033 0.0413 0.0028 -0.03 0.0157 -0.025 0.0055 0.0504 -0.026 0.0284 0.0566 0.014 -0.028 -0.019 0.0008 0.0148 0.0168 -0.026 0.0216 0.0086 -0.043 0.0333 0.0384 -0.166 0.0405 0.0179 0.0245 -0.086 0.0225 -0.1 -0.055 -0.165 -0.081 -0.125 0.1073 0.0408 -0.043 0.0036 -0.072 0.3076 -1.104 12.949 -0.564 -0.214 0.0849 -0.839 16.524 -0.6 -0.178

    -0.058 -0.047 0.0418 -0.006 -0.022 0.0139 -0.029 0.0051 0.0554 -0.029 0.0167 0.0387 0.0099 -0.03 -0.019 0.0096 0.017 0.0046 -0.055 0.0512 0.0148 -0.078 0.0124 0.0606 -0.165 0.014 0.0093 0.0286 -0.098 0.0111 -0.209 -0.119 -0.099 -0.115 -0.104 0.0702 0.0443 -0.07 0.004 -0.06 0.2675 -1.053 12.427 -0.569 -0.216 0.1015 -0.952 18.129 -0.712 -0.199

    -0.058 -0.047 0.0418 -0.006 -0.022 0.0139 -0.029 0.0051 0.0554 -0.029 0.0167 0.0387 0.0099 -0.03 -0.019 0.0096 0.017 0.0046 -0.055 0.0512 0.0148 -0.078 0.0124 0.0606 -0.165 0.014 0.0093 0.0286 -0.098 0.0111 -0.209 -0.119 -0.099 -0.115 -0.104 0.0702 0.0443 -0.07 0.004 -0.06 0.2675 -1.053 12.427 -0.569 -0.216 0.1015 -0.952 18.129 -0.712 -0.199

    -0.055 -0.04 0.0276 0.008 -0.013 0.0141 -0.015 0.0103 0.0624 -0.023 0.0094 0.0428 0.0186 -0.022 -0.026 0.024 0.0173 0.011 -0.023 0.0372 -0.005 -0.056 0.0099 0.0325 -0.161 0.0616 0.0266 0.0134 -0.075 0.0091 -0.056 -0.059 -0.082 -0.068 -0.101 -0.006 0.0339 -0.054 -0.028 -0.028 0.1795 -0.901 10.876 -0.472 -0.159 0.1175 -0.649 11.869 -0.469 -0.081

    -0.058 -0.04 0.031 0.0081 -0.015 0.0093 -0.02 0.0166 0.0718 -0.017 0.014 0.0508 0.0162 -0.026 -0.031 0.0236 0.0207 0.01 -0.024 0.0491 -0.012 -0.056 0.0156 0.0666 -0.176 0.0688 0.0651 0.0019 -0.077 0.0143 -0.041 -0.062 -0.107 -0.065 -0.108 -0.008 0.0303 -0.065 -0.035 -0.069 0.2156 -1.081 13.242 -0.586 -0.215 0.1199 -0.706 12.913 -0.523 -0.102

    -0.067 -0.038 0.029 0.0079 -0.018 0.0039 -0.01 0.0175 0.0621 -0.024 0.0291 0.0523 0.0124 -0.039 -0.024 -7E-04 0.021 0.0027 -0.015 0.0059 0.0083 -0.013 0.0189 0.0711 -0.143 0.0708 0.0285 0.0064 -0.118 0.0518 -0.034 -0.045 -0.095 -0.049 -0.108 0.0188 0.0271 -0.033 -0.009 -0.089 0.2802 -1.218 15.067 -0.677 -0.221 0.1039 -0.591 10.884 -0.387 -0.179

    -0.054 -0.034 0.0275 0.0159 -0.017 0.0079 0.0014 0.0122 0.0463 -0.031 0.0168 0.0424 0.0165 -0.028 -0.014 -0.01 0.0132 0.0024 -0.007 -0.01 -0.004 0.0403 0.0105 0.0372 -0.063 0.0216 0.005 0.0128 -0.097 0.0296 -0.013 -0.046 -0.088 -0.043 -0.093 0.0191 0.0259 -0.003 0.0048 -0.092 0.2411 -1.132 14.287 -0.626 -0.187 0.1201 -0.331 5.9502 -0.157 -0.16

    -0.053 -0.045 0.0263 0.0155 -0.013 0.0161 -0.005 0.0101 0.0419 -0.04 0.0089 0.0459 0.0159 -0.024 0.0009 -0.021 0.0076 0.0012 -0.009 -0.011 -0.016 0.0145 0.0354 0.0428 -0.089 0.006 -0.004 0.0827 -0.135 0.0058 -0.027 -0.047 -0.099 -0.046 -0.119 0.059 0.0257 0.0052 0.0035 -0.118 0.3354 -1.445 18.278 -0.802 -0.243 0.1284 -0.402 8.0545 -0.255 -0.252

    -0.053 -0.045 0.0263 0.0155 -0.013 0.0161 -0.005 0.0101 0.0419 -0.04 0.0089 0.0459 0.0159 -0.024 0.0009 -0.021 0.0076 0.0012 -0.009 -0.011 -0.016 0.0145 0.0354 0.0428 -0.089 0.006 -0.004 0.0827 -0.135 0.0058 -0.027 -0.047 -0.099 -0.046 -0.119 0.059 0.0257 0.0052 0.0035 -0.118 0.3354 -1.445 18.278 -0.802 -0.243 0.1284 -0.402 8.0545 -0.255 -0.252

    -0.057 -0.036 0.0221 0.0178 -0.019 0.014 -0.009 0.0236 0.0611 -0.024 0.012 0.0655 0.0259 -0.009 -0.013 -0.007 0.0082 0.0077 -0.006 0.0073 -0.024 -0.006 0.0727 0.0338 -0.105 0.0251 0.0579 0.036 -0.077 -0.003 0.0204 -0.05 -0.14 -0.025 -0.137 0.0423 0.0301 -0.011 -0.031 -0.167 0.3447 -1.656 21.047 -0.911 -0.297 0.1279 -0.431 8.2874 -0.283 -0.174

    -0.057 -0.036 0.0221 0.0178 -0.019 0.014 -0.009 0.0236 0.0611 -0.024 0.012 0.0655 0.0259 -0.009 -0.013 -0.007 0.0082 0.0077 -0.006 0.0073 -0.024 -0.006 0.0727 0.0338 -0.105 0.0251 0.0579 0.036 -0.077 -0.003 0.0204 -0.05 -0.14 -0.025 -0.137 0.0423 0.0301 -0.011 -0.031 -0.167 0.3447 -1.656 21.047 -0.911 -0.297 0.1279 -0.431 8.2874 -0.283 -0.174

    -0.064 -0.033 0.0178 0.01 -0.024 0.0114 -0.017 0.0154 0.0745 -0.017 0.0185 0.0589 0.0274 -0.017 -0.031 0.0145 0.0204 0.0205 -0.019 0.0271 -0.012 -0.046 0.0397 0.0275 -0.18 0.0815 0.0943 -3E-04 -0.075 0.0052 0.0041 -0.044 -0.114 -0.03 -0.117 0.0214 0.03 -0.034 -0.041 -0.095 0.266 -1.158 14.249 -0.608 -0.217 0.1104 -0.638 11.906 -0.452 -0.071

    -0.064 -0.033 0.0178 0.01 -0.024 0.0114 -0.017 0.0154 0.0745 -0.017 0.0185 0.0589 0.0274 -0.017 -0.031 0.0145 0.0204 0.0205 -0.019 0.0271 -0.012 -0.046 0.0397 0.0275 -0.18 0.0815 0.0943 -3E-04 -0.075 0.0052 0.0041 -0.044 -0.114 -0.03 -0.117 0.0214 0.03 -0.034 -0.041 -0.095 0.266 -1.158 14.249 -0.608 -0.217 0.1104 -0.638 11.906 -0.452 -0.071

    -0.061 -0.033 0.0142 0.0098 -0.022 0.0162 -0.013 0.0092 0.0652 -0.022 0.014 0.0508 0.0297 -0.013 -0.026 0.015 0.017 0.0214 -0.017 0.0211 -0.009 -0.046 0.034 0.0129 -0.166 0.0741 0.0412 0.011 -0.072 0.0027 -0.003 -0.04 -0.089 -0.033 -0.11 0.0235 0.0336 -0.023 -0.034 -0.053 0.2298 -0.977 11.884 -0.494 -0.162 0.1082 -0.58 10.862 -0.398 -0.051

    -0.061 -0.033 0.0142 0.0098 -0.022 0.0162 -0.013 0.0092 0.0652 -0.022 0.014 0.0508 0.0297 -0.013 -0.026 0.015 0.017 0.0214 -0.017 0.0211 -0.009 -0.046 0.034 0.0129 -0.166 0.0741 0.0412 0.011 -0.072 0.0027 -0.003 -0.04 -0.089 -0.033 -0.11 0.0235 0.0336 -0.023 -0.034 -0.053 0.2298 -0.977 11.884 -0.494 -0.162 0.1082 -0.58 10.862 -0.398 -0.051

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.024 0.0064 0.049 0.0314 -0.006 -0.021 0.0051 0.0128 0.0202 -0.011 0.0114 -0.018 -0.02 0.0312 0.0153 -0.081 0.027 0.0379 0.006 -0.064 -0.006 0.0251 -0.044 -0.107 -0.025 -0.102 0.0218 0.0288 -0.004 -0.028 -0.098 0.2268 -1.071 13.469 -0.557 -0.184 0.1268 -0.377 6.9721 -0.221 -0.052

    -0.05 -0.028 0.0161 0.0179 -0.024 0.0155 -0.006 0.0102 0.0588 -0.0