real-time acquisition and processing of data from the gmrt pulsar back- ends ramchandra m. dabade...
TRANSCRIPT
![Page 1: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/1.jpg)
Real-time Acquisition and Processing of Data
from the GMRT Pulsar Back-ends
Ramchandra M. Dabade(VNIT, Nagpur)
Guided By,Yashwant Gupta
![Page 2: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/2.jpg)
Objectives● 'Software subsection' of pulsar data acquisition system
● Online processing facilities:
– Checking data integrity: Marker, GPS bit check
– Monitoring data quality: psr_mon, channel monitoring
– Real time post processing: GPS time stamping, Time and frequency integrations, bit packing, de dispersion, gating.
![Page 3: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/3.jpg)
Plan
● Pulsar - Overview
● Basic processing techniques
– Marker check
– GPS time stamping
– Time/Frequency integrations
● Bit Packing
● De dispersion/gating
● psr_mon
● Others – supporting programs, data format at different points in pulsar data
![Page 4: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/4.jpg)
Pulsars – an overview● Highly magnetised, rapidly-
rotating neutron stars
● “True north” and “magnetic north” are misaligned.
● Period – ranges from few seconds to milliseconds
![Page 5: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/5.jpg)
Pulsar observations @ GMRT● Incoherent array mode
● Coherent array mode
● Polarimeter
● Spectral resolution – 16MHz BW divided into 256 channels
● Time resolution requirements
● High data rates
– 0.5 ms sampling will give: 256/(0.5x10e-3)=512K channels, with each channel 2 bytes = 1Mb and full polar mode = 4Mb
![Page 6: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/6.jpg)
Basic data flow – software sequence
●Inter process communication●Modes : For all – ia, pa, polarimeter same software can be used●Format of the output data
![Page 7: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/7.jpg)
Markers and marker check● Marker - Periodic patterns
embedded in data
● To check data integrity
● To know the start of the time sample
● Marker scheme for IA/PA
● Marker scheme for polarimeter
![Page 8: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/8.jpg)
GPS Time stamping of data● Pulsars – most stable of known
natural clocks
● Pulsar Timing studies
● GPS – provides accurate clocks
● GPS information in GMRT pulsar data
● Getting more accurate time stamps
![Page 9: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/9.jpg)
Post Time and frequency integrations● What is this?
● Need?
● Time integrations increase SNR
● Time resolution is decreased
● Frequency resolution is reduced – dispersion effects may increase
![Page 10: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/10.jpg)
Profile with no time and frequency integrations Profile with 2 time integrations (post integrations) Profile with 4 time integrations (post integrations)
![Page 11: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/11.jpg)
Bit Packing● Concept
● One biting – 80% of information from original signal is retained
● Pulsar search – One biting, IA mode
● Running mean subtraction
– Threshold for bit quantization
– Running mean window
● Data is packed into 16-bit integer
![Page 12: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/12.jpg)
![Page 13: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/13.jpg)
Dispersion● Dispersion - ?
● Effect: The pulse is detected at the high frequency end of the band before it arrives at low frequency end.
● Dispersion Measure – Column density of free electrons along the line of sight to the pulsar
● Spectral line observations for pulsar signal required at radio frequencies
![Page 14: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/14.jpg)
De dispersion● De dispersion – compensation of interstellar dispersion
● Incoherent de dispersion
● Implementation of incoherent de dispersion
● For each frequency channel, the dispersion delay is calculated in terms of integer number of bins
● Data [N_ch X (n_tdelay+1)] is buffered in circular manner
![Page 15: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/15.jpg)
0
1
254
255
N+mN N+1 N+m-1
N#255
N#254
N#1
N#0
N#255
N#254
N#1
N#0
N#254
N#1
N#0
Incoherent dedispersion algorithm
![Page 16: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/16.jpg)
Dispersed vs. de dispersed data
![Page 17: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/17.jpg)
Gating
● Pulse has 5-10% duty cycle
● Gating – setting an on-pulse time window, recording the data within the window and rejecting the rest
● Setting a gate – data is folded
● Requirement of two gates
● Phase resolution = sampling time / period
● In each gate fixed number of bins are recorded
![Page 18: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/18.jpg)
Monitoring program – psr_mon
● Different plots:
– Band shape
– Time series
– Profiles
● Advantages – Monitoring data quality, pulse presence, drift in the pulse
● Reading from shared memory/ file
● Input parameter file – psr_online.in
![Page 19: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/19.jpg)
![Page 20: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/20.jpg)
Other programs● Read_acqpsr – recording data directly from shared memory
– Marker check
– No gps check – time stamping● unpack_recdata – unpacking bit packed data
– Also useful for splitting 4K header and Data● psr_srv – communicating with 'online'
– Interface provided by sockngetcmd, which can act as server, client or simply taking command string from terminal/console
● acqsimf – same as acqpsr, reads data from file instead of
![Page 21: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/21.jpg)
Data formats at different points in pulsar data flow
![Page 22: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/22.jpg)
Performance!● Current software is used for the full speed provided by the
hardware.
– For IA mode - 0.128ms (sampling rate)
– For PA mode - 0.256 ms -- Total intensity
– For Polarimeter - 64 microseconds -- Total intensity● Analysis using acqsimf program was carried out, it shows data
up to 1 integration (same as raw data) can be handled with the existing shared memory size
![Page 23: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/23.jpg)
Conclusion and future scope
● Software is being used for the routine observations
● The modules are tested and working well
● This is the first module for the pulsar DAS software subsection and can be advanced!
● Future scope –
– GPS time stamping for polarimeter
– Online recording of folded data
– Increasing number of gates in gating
– Different real time techniques● Road ahead…!
![Page 24: Real-time Acquisition and Processing of Data from the GMRT Pulsar Back- ends Ramchandra M. Dabade (VNIT, Nagpur) Guided By, Yashwant Gupta](https://reader036.vdocuments.net/reader036/viewer/2022062517/56649f285503460f94c40292/html5/thumbnails/24.jpg)
Thank You!