shipboard adcp processing workshop feb 18, 2018 university of … · 2018-02-19 · shipboard adcp...
TRANSCRIPT
![Page 1: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/1.jpg)
Shipboard ADCP processing workshop Feb 18, 2018
University of Alaska, Fairbanks
UHDAS ADCP data Acquisition and CODAS processing
UHDAS + CODAS Documentation
http://currents.soest.hawaii.edu/docs/adcp_doc/index.html
Shipboard ADCP processing workshop Feb 18, 2018
University of Alaska, Fairbanks
UHDAS ADCP data Acquisition and CODAS processing
UHDAS + CODAS Documentation
http://currents.soest.hawaii.edu/docs/adcp_doc/index.html
![Page 2: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/2.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 3: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/3.jpg)
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
![Page 4: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/4.jpg)
UHDAS - What it does (follow the data)
(1) Acquisition ADCP+position+heading (2) Processing (3) Data Access - At Sea - On Land (after the cruise) (4) Monitoring At Sea On Land
UHDAS - What it does (follow the data)
(1) Acquisition ADCP+position+heading (2) Processing (3) Data Access - At Sea - On Land (after the cruise) (4) Monitoring At Sea On Land
![Page 5: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/5.jpg)
UHDAS - What it does (follow the data)
(1) Acquisition (2) Processing CODAS (3) Data Access - At Sea - On Land (after the cruise) (4) Monitoring At Sea On Land
UHDAS - What it does (follow the data)
(1) Acquisition (2) Processing CODAS (3) Data Access - At Sea - On Land (after the cruise) (4) Monitoring At Sea On Land
![Page 6: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/6.jpg)
UHDAS: What it does
● (1) Data Acquisition● communicate with ADCP● timestamp data, write to disk● keep log files about activities
● (2) Processing● parse NMEA messages● grid NMEA messages● all CODAS processing
UHDAS: What it does
● (1) Data Acquisition● communicate with ADCP● timestamp data, write to disk● keep log files about activities
● (2) Processing● parse NMEA messages● grid NMEA messages● all CODAS processing
![Page 7: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/7.jpg)
UHDAS: What it does:
(3) Data Access...● web site on ship with
● plots for science and operations● full-resolution data (matlab, netcdf, CODAS)
● on land (in the cruise directory)● full-resolution data (matlab, netcdf, CODAS)● archive of figures from cruise
UHDAS: What it does:
(3) Data Access...● web site on ship with
● plots for science and operations● full-resolution data (matlab, netcdf, CODAS)
● on land (in the cruise directory)● full-resolution data (matlab, netcdf, CODAS)● archive of figures from cruise
![Page 8: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/8.jpg)
UHDAS: What it does
(4) Monitoring...● at sea:
● data acquisition (UHDAS GUI tool)● processing ● health of accurate heading device
● from shore: (uhdas.org)● sends daily email with attachment for review● diagnostic files● data snippet for shore-based figures for review
green=goodred=rubbish
web site figures
web site figures
UHDAS: What it does
(4) Monitoring...● at sea:
● data acquisition (UHDAS GUI tool)● processing ● health of accurate heading device
● from shore: (uhdas.org)● sends daily email with attachment for review● diagnostic files● data snippet for shore-based figures for review
green=goodred=rubbish
web site figures
web site figures
![Page 9: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/9.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 10: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/10.jpg)
(I) ADCP: Getting Ocean Velocity
ADCP : Acoustic (it pings along beams at a frequency)Doppler (uses frequency shift to get velocity along the beam)Current (include many more steps to get ocean velocity)Profiler (listen for the return in small chunks of time to create a vertical profile)
(I) ADCP: Getting Ocean Velocity
ADCP : Acoustic (it pings along beams at a frequency)Doppler (uses frequency shift to get velocity along the beam)Current (include many more steps to get ocean velocity)Profiler (listen for the return in small chunks of time to create a vertical profile)
![Page 11: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/11.jpg)
ADCP introduction
● Acoustic Doppler Current Profiler (shipboard)● 4-beams, Doppler shifted currents as ship moves● To obtain ocean currents:
(1) transform beam coordinatesbeam coordinates into instrument coordinates(2) rotate horizontal velocities into ship coordinates using transducer angle in the hulltransducer angle in the hull (EA command for VmDAS)(3) rotate velocities on ship to North (using headingheading)● yields measured velocities in Earth coordinates(4) remove ship’s speed using positionspositions
● link to diagrams
ADCP introduction
● Acoustic Doppler Current Profiler (shipboard)● 4-beams, Doppler shifted currents as ship moves● To obtain ocean currents:
(1) transform beam coordinatesbeam coordinates into instrument coordinates(2) rotate horizontal velocities into ship coordinates using transducer angle in the hulltransducer angle in the hull (EA command for VmDAS)(3) rotate velocities on ship to North (using headingheading)● yields measured velocities in Earth coordinates(4) remove ship’s speed using positionspositions
● link to diagrams
![Page 12: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/12.jpg)
(I) ADCP: Getting Ocean Velocity
ADCP : AcousticDopplerCurrentProfiler
(I) ADCP: Getting Ocean Velocity
ADCP : AcousticDopplerCurrentProfiler
![Page 13: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/13.jpg)
ADCP :
Acoustic DopplerCurrentProfiler
ADCP :
Acoustic DopplerCurrentProfiler
![Page 14: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/14.jpg)
ADCP:AcousticDoppler Current Profiler
ADCP:AcousticDoppler Current Profiler
![Page 15: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/15.jpg)
ADCP : Getting Ocean Currents
ADCP : Getting Ocean Currents
![Page 16: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/16.jpg)
ADCP : Getting Ocean Currents
ADCP : Getting Ocean Currents
![Page 17: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/17.jpg)
ADCPGetting OceanCurrents
Four beams● 90deg apart● 30 (or 20)deg up
from vertical● “forward beam”
is #3● usually 45deg
starboard of forward
ADCPGetting OceanCurrents
Four beams● 90deg apart● 30 (or 20)deg up
from vertical● “forward beam”
is #3● usually 45deg
starboard of forward
![Page 18: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/18.jpg)
ADCPGetting Ocean Currents
Four beams● 90deg apart● 30 (or 20)deg up
from vertical● “forward beam” is #3● usually 45deg starboard
of forward
ADCPGetting Ocean Currents
Four beams● 90deg apart● 30 (or 20)deg up
from vertical● “forward beam” is #3● usually 45deg starboard
of forward
![Page 19: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/19.jpg)
ADCPGetting Ocean Currents
Two oppositebeams make avertical plane
ADCPGetting Ocean Currents
Two oppositebeams make avertical plane
![Page 20: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/20.jpg)
ADCPGetting Ocean Currents
Now we have two vertical planesat 90deg to each other
These are the basis of the horizontal and vertical velocities
Horizontal velocities will be usedto get ocean velocities
Vertical velocities will be used forerror-checking
ADCPGetting Ocean Currents
Now we have two vertical planesat 90deg to each other
These are the basis of the horizontal and vertical velocities
Horizontal velocities will be usedto get ocean velocities
Vertical velocities will be used forerror-checking
![Page 21: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/21.jpg)
ADCPGetting Ocean Currents
Two beams makeone vertical plan
This shows thevelocities determinedby the Doppler shift;
“beam velocities”
ADCPGetting Ocean Currents
Two beams makeone vertical plan
This shows thevelocities determinedby the Doppler shift;
“beam velocities”
![Page 22: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/22.jpg)
ADCP: Getting Ocean Currents
Interpret the two beam velocitiesone horizontal and one verticalvelocity
ADCP: Getting Ocean Currents
Interpret the two beam velocitiesone horizontal and one verticalvelocity
![Page 23: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/23.jpg)
ADCP: Getting Ocean Currents
Now we see the horizontal andvertical velocities on the two planes
Use the horizontal velocities for determining ocean velocities requires more steps.
ADCP: Getting Ocean Currents
Now we see the horizontal andvertical velocities on the two planes
Use the horizontal velocities for determining ocean velocities requires more steps.
![Page 24: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/24.jpg)
ADCP: Getting Ocean Currents
This is a top-down view of the measuredhorizontal velocity ininstrument coordinates(from the two planesmade by the beams)
(determining oceanvelocities requiresmore steps)
ADCP: Getting Ocean Currents
This is a top-down view of the measuredhorizontal velocity ininstrument coordinates(from the two planesmade by the beams)
(determining oceanvelocities requiresmore steps)
![Page 25: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/25.jpg)
ADCP: Getting Ocean Currents
This is a top-downview of the measured horizontal velocityin ship coordinates.
The instrumentcoordinates valuesare rotated by thetransducer angle.
(determining oceanvelocities requiresmore steps)
ADCP: Getting Ocean Currents
This is a top-downview of the measured horizontal velocityin ship coordinates.
The instrumentcoordinates valuesare rotated by thetransducer angle.
(determining oceanvelocities requiresmore steps)
![Page 26: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/26.jpg)
ADCP: Getting Ocean Currents
This is a top-downview of the measured horizontal velocityin earth coordinates.
The instrumentcoordinates valuesare rotated by theship's heading.
(determining oceanvelocities requiresmore steps)
ADCP: Getting Ocean Currents
This is a top-downview of the measured horizontal velocityin earth coordinates.
The instrumentcoordinates valuesare rotated by theship's heading.
(determining oceanvelocities requiresmore steps)
![Page 27: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/27.jpg)
ADCP: Getting Ocean Currents
Summary of steps:
Doppler to beam (not shown)
below here: horizontal+vertical
● beam to instrument ● instrument to ship● ship to earth
ADCP: Getting Ocean Currents
Summary of steps:
Doppler to beam (not shown)
below here: horizontal+vertical
● beam to instrument ● instrument to ship● ship to earth
![Page 28: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/28.jpg)
ADCP: Getting Ocean Currents
Earth coordinates + GPSgives ship speed
add ship speed to measured velocityto getocean velocity
ADCP: Getting Ocean Currents
Earth coordinates + GPSgives ship speed
add ship speed to measured velocityto getocean velocity
![Page 29: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/29.jpg)
ADCP: Getting Ocean Currents
Complete summary:
beam velocities
+
transducer orientation +
heading
+
gps
ocean velocities
ADCP: Getting Ocean Currents
Complete summary:
beam velocities
+
transducer orientation +
heading
+
gps
ocean velocities
![Page 30: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/30.jpg)
beam velocities
+
transducer orientation +
heading
+gps
ocean velocities
ADCP: Data components
ADCP
attitude
position
(processing)
calibration
beam velocities
+
transducer orientation +
heading
+gps
ocean velocities
ADCP: Data components
ADCP
attitude
position
(processing)
calibration
![Page 31: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/31.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 32: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/32.jpg)
Time, ADCP,Position,Attitude
primitive (raw) data
TimeADCPPositionHeading
Timestamp,Write to disk
DATA PROCESSING
DATA ACQUISITION
(Data Products)(Visualization)
Time, ADCP,Position,Attitude
primitive (raw) data
TimeADCPPositionHeading
Timestamp,Write to disk
DATA PROCESSING
DATA ACQUISITION
(Data Products)(Visualization)
![Page 33: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/33.jpg)
ADCP Acquisition Systems
● VmDAS (provided with purchase)● UHDAS (developed at Univ Hawaii)
● Installed on UNOLS ships, rolling out to NOAA ships● Link to Table of ships
There are two acquisition systems for vessel-mounted ADCPs:
● Basic requirements● Processing● Monitoring
Components – Overview:
ADCP Acquisition Systems
● VmDAS (provided with purchase)● UHDAS (developed at Univ Hawaii)
● Installed on UNOLS ships, rolling out to NOAA ships● Link to Table of ships
There are two acquisition systems for vessel-mounted ADCPs:
● Basic requirements● Processing● Monitoring
Components – Overview:
![Page 34: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/34.jpg)
ADCP Acquisition Systems: Overview
● Basic requirements:● Control ADCP settings● Acquire ADCP data● Acquire ancillary data
– Position– Attitude (heading)
● Timestamp all
● Processing● Monitoring
Core
Extra
ADCP Acquisition Systems: Overview
● Basic requirements:● Control ADCP settings● Acquire ADCP data● Acquire ancillary data
– Position– Attitude (heading)
● Timestamp all
● Processing● Monitoring
Core
Extra
![Page 35: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/35.jpg)
ADCP Acquisition Systems: Overview
● Basic requirements● Processing
● Coordinate transformation● Editing● Averaging● Graphical Displays
● Monitoring
ADCP Acquisition Systems: Overview
● Basic requirements● Processing
● Coordinate transformation● Editing● Averaging● Graphical Displays
● Monitoring
![Page 36: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/36.jpg)
ADCP Acquisition Systems: Overview
● Basic requirements● Processing● Monitoring
● Computer system● Data acquisition● Processing● Access to data
ADCP Acquisition Systems: Overview
● Basic requirements● Processing● Monitoring
● Computer system● Data acquisition● Processing● Access to data
![Page 37: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/37.jpg)
ADCP Acquisition systems: Details
● Basic requirements: ● Overview● Serial setup● Data logging
● Processing● Monitoring
Comparison (UHDAS/VmDAS)
ADCP Acquisition systems: Details
● Basic requirements: ● Overview● Serial setup● Data logging
● Processing● Monitoring
Comparison (UHDAS/VmDAS)
![Page 38: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/38.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
38: Outline
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
38: Outline
![Page 39: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/39.jpg)
ADCP Acquisition Systems- Overview UHDAS VmDAS
developer Univ Hawaii TRDIstyle linux system windows applicationsource open source executablepurpose seagoing all-purpose oceanographers goals maximize off-the-shelf - usefulness at sea - long-term value for researchevolution continuous incrementalsetup complex confusing
ADCP Acquisition Systems- Overview UHDAS VmDAS
developer Univ Hawaii TRDIstyle linux system windows applicationsource open source executablepurpose seagoing all-purpose oceanographers goals maximize off-the-shelf - usefulness at sea - long-term value for researchevolution continuous incrementalsetup complex confusing
![Page 40: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/40.jpg)
ADCP Acquisition: Serial Setup
UHDAS VmDASADCPs multiple one (per computer)feeds any number 3 (older version=2)messages many types fewer types can add more subsample feed record all choose messages record allGUI controls instrument settings everythingoperation simple simple/confusingprotected serial nothing protected processing
ADCP Acquisition: Serial Setup
UHDAS VmDASADCPs multiple one (per computer)feeds any number 3 (older version=2)messages many types fewer types can add more subsample feed record all choose messages record allGUI controls instrument settings everythingoperation simple simple/confusingprotected serial nothing protected processing
![Page 41: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/41.jpg)
Acquisition: Data Logging
UHDAS VmDASdata logging separate one big program processes time tagging buffered unbuffered tag every line tag ensembledata formats multiple TRDI ADCPdata directory heirarchical flattime range match per file match for one logging periodfilenames sort always one logging period (time=ascii) metadata stored with data text file elsewhere
Acquisition: Data Logging
UHDAS VmDASdata logging separate one big program processes time tagging buffered unbuffered tag every line tag ensembledata formats multiple TRDI ADCPdata directory heirarchical flattime range match per file match for one logging periodfilenames sort always one logging period (time=ascii) metadata stored with data text file elsewhere
![Page 42: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/42.jpg)
ADCP Acquisition Systems: Comparison
● Basic requirements● Overview● Serial setup● Data logging
● Processing● Processing components● Accessing data products
● Monitoring
ADCP Acquisition Systems: Comparison
● Basic requirements● Overview● Serial setup● Data logging
● Processing● Processing components● Accessing data products
● Monitoring
![Page 43: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/43.jpg)
Processing: Comparison UHDAS VmDASediting CODAS minimalheading reliable primary secondary corrected to replaced by heading accurate fallbackpings interleaved firstconfigure no yes plots?? plots oceanographic: - profiles (E,N) profile (speed, dir) - vector (+topo) vector - contour WinADCP? - bridge (mariner)
Processing: Comparison UHDAS VmDASediting CODAS minimalheading reliable primary secondary corrected to replaced by heading accurate fallbackpings interleaved firstconfigure no yes plots?? plots oceanographic: - profiles (E,N) profile (speed, dir) - vector (+topo) vector - contour WinADCP? - bridge (mariner)
![Page 44: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/44.jpg)
Accessing Data Products UHDAS VmDASaccess plots ship's web console only consoledata formats TRDI TRDI Matlab netCDFaccess data ship's web acquisition PC windows share windows share NFSdocumentation ship's web acquisition PC www wwwspeedlog out yes yes
Accessing Data Products UHDAS VmDASaccess plots ship's web console only consoledata formats TRDI TRDI Matlab netCDFaccess data ship's web acquisition PC windows share windows share NFSdocumentation ship's web acquisition PC www wwwspeedlog out yes yes
![Page 45: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/45.jpg)
ADCP Acquisition Systems: Comparison
● Basic requirements● Overview● Serial setup● Data logging
● Processing● Processing components● Accessing data products
● Monitoring
ADCP Acquisition Systems: Comparison
● Basic requirements● Overview● Serial setup● Data logging
● Processing● Processing components● Accessing data products
● Monitoring
![Page 46: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/46.jpg)
Monitoring UHDAS VmDAS
computer daily report noserial daily_report LOG and console messages configure tablesADCP beam plots configure plotsProcessing daily_report configure plots plots calibration no ping rate ? bottom track noremotely email to anyone no
Monitoring UHDAS VmDAS
computer daily report noserial daily_report LOG and console messages configure tablesADCP beam plots configure plotsProcessing daily_report configure plots plots calibration no ping rate ? bottom track noremotely email to anyone no
![Page 47: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/47.jpg)
Time, ADCP,Position,Attitude
primitive (raw) data
TimeADCPPositionHeading
Timestamp,Write to disk
DATA PROCESSING
DATA ACQUISITION
(Data Products)(Visualization)
Time, ADCP,Position,Attitude
primitive (raw) data
TimeADCPPositionHeading
Timestamp,Write to disk
DATA PROCESSING
DATA ACQUISITION
(Data Products)(Visualization)
![Page 48: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/48.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 49: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/49.jpg)
Break now? or in 10-15 min?
(information flow is betterif we hang on for one
more section...)
Break now? or in 10-15 min?
(information flow is betterif we hang on for one
more section...)
![Page 50: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/50.jpg)
CODAS Processing
UHDAS:●acquisition
Cruise directory structureGridding raw data before averaging
CODAS Processing
UHDAS:●acquisition
Cruise directory structureGridding raw data before averaging
![Page 51: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/51.jpg)
UHDAS cruise directory structure
(link in documentation – [raw+rbin+gbin] directories)
UHDAS cruise directory structure
(link in documentation – [raw+rbin+gbin] directories)
![Page 52: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/52.jpg)
![Page 53: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/53.jpg)
![Page 54: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/54.jpg)
![Page 55: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/55.jpg)
![Page 56: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/56.jpg)
![Page 57: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/57.jpg)
![Page 58: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/58.jpg)
![Page 59: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/59.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 60: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/60.jpg)
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
![Page 61: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/61.jpg)
CODAS Processing Overview
CODAS: Common Ocean Data Access System● Portable (multiple operating systems)● Self-descriptive (like netCDF)● Aggregated files (multiple files)● Designed for ADCP data“CODAS Processing” → produce ocean velocities● Tools to access and modify CODAS files
CODAS Processing Overview
CODAS: Common Ocean Data Access System● Portable (multiple operating systems)● Self-descriptive (like netCDF)● Aggregated files (multiple files)● Designed for ADCP data“CODAS Processing” → produce ocean velocities● Tools to access and modify CODAS files
![Page 62: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/62.jpg)
“CODAS” ADCP ProcessingGoals● Run on multiple operating systems
– (Windows, OSX, Linux)● Open source, free (Python)● Flexible (tweak, tune, patch, augment)Processing● Written for ADCP data● Works with most RDI ADCPs (link)● Balance real-time product with recoverable dataset● Single-ping (automated) and manual editing● Calibration diagnostics and routines● Documented
CODAS = “Common Ocean Data Access System”(*) via VirtualBox pre-configured Linux computer
(*)
“CODAS” ADCP ProcessingGoals● Run on multiple operating systems
– (Windows, OSX, Linux)● Open source, free (Python)● Flexible (tweak, tune, patch, augment)Processing● Written for ADCP data● Works with most RDI ADCPs (link)● Balance real-time product with recoverable dataset● Single-ping (automated) and manual editing● Calibration diagnostics and routines● Documented
CODAS = “Common Ocean Data Access System”(*) via VirtualBox pre-configured Linux computer
(*)
![Page 63: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/63.jpg)
CODAS Processing Supports...
CODAS Processing Supports...
![Page 64: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/64.jpg)
CODAS processing: 2 modes(1) process single-ping data
– beam-to-earth coordinates– single-ping editing (acoustic interference, bottom)– create averages; save to disk– load averages into CODAS database
(2) load averaged data into CODAS database– 1980’s PINGDATA– VmDAS: *.LTA, *.STA
(no single-ping editing)
Next: “post-processing steps”
CODAS processing: 2 modes(1) process single-ping data
– beam-to-earth coordinates– single-ping editing (acoustic interference, bottom)– create averages; save to disk– load averages into CODAS database
(2) load averaged data into CODAS database– 1980’s PINGDATA– VmDAS: *.LTA, *.STA
(no single-ping editing)
Next: “post-processing steps”
![Page 65: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/65.jpg)
CODAS post-processing:● View figures and logfiles● Fix heading:
● patch gappy but accurate heading correction (if relevant)● apply time-dependent heading correction
● Determine corrections/calibrations, then apply● remaining transducer offset● scale factor (if relevant)● transducer-GPS offset (in meters)
● Manually edit out bad data (“gee-autoedit” tutorial)● graphically select bins, profiles● using thresholds
● check calibrations● make figures (web page); export data (matlab, netCDF)
CODAS post-processing:● View figures and logfiles● Fix heading:
● patch gappy but accurate heading correction (if relevant)● apply time-dependent heading correction
● Determine corrections/calibrations, then apply● remaining transducer offset● scale factor (if relevant)● transducer-GPS offset (in meters)
● Manually edit out bad data (“gee-autoedit” tutorial)● graphically select bins, profiles● using thresholds
● check calibrations● make figures (web page); export data (matlab, netCDF)
![Page 66: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/66.jpg)
CODAS software tools:● Tools for or raw (single-ping) ADCP data:● visualization of beam values
● RSSI (signal return)● beam velocity
● estimate EA (transducer angle)● conversion of NMEA strings to “rbin” data files
● N1R, N2R, N3R (from VmDAS)● UHDAS raw serial data
● tools to plot rbin data:● plot POSMV quality ● plot navigation over topography● plot one (or compare two) rbin data streams
RDIADCPs
UHDASdataproducts
CODAS software tools:● Tools for or raw (single-ping) ADCP data:● visualization of beam values
● RSSI (signal return)● beam velocity
● estimate EA (transducer angle)● conversion of NMEA strings to “rbin” data files
● N1R, N2R, N3R (from VmDAS)● UHDAS raw serial data
● tools to plot rbin data:● plot POSMV quality ● plot navigation over topography● plot one (or compare two) rbin data streams
RDIADCPs
UHDASdataproducts
![Page 67: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/67.jpg)
![Page 68: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/68.jpg)
These stepsuse only theCODAS filesso work on any averageddata, regardlessof the source- single-ping editing- LTA/STA- PINGDATA
These stepsuse only theCODAS filesso work on any averageddata, regardlessof the source- single-ping editing- LTA/STA- PINGDATA
![Page 69: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/69.jpg)
At Sea
At Home
ENR
At Sea
At Home
ENR
![Page 70: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/70.jpg)
CODAS Processing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Editing CODAS database averages “gee-autoedit”
● Interpolate missing heading correction● Apply calibrations
● Scale factor● Rotation● Transducer offset (new)
CODAS Processing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Editing CODAS database averages “gee-autoedit”
● Interpolate missing heading correction● Apply calibrations
● Scale factor● Rotation● Transducer offset (new)
![Page 71: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/71.jpg)
CODAS Processing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Editing CODAS database averages “gee-autoedit”
● Interpolate missing heading correction● Apply calibrations
● Scale factor● Rotation● Transducer offset (uncommon/experimental)
BEFORE AVERAGING
CODAS Processing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Editing CODAS database averages “gee-autoedit”
● Interpolate missing heading correction● Apply calibrations
● Scale factor● Rotation● Transducer offset (uncommon/experimental)
BEFORE AVERAGING
![Page 72: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/72.jpg)
ADCP Single-ping Editing The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
Both tend to cause bias towards zero in measured velocity
ADCP Single-ping Editing The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
Both tend to cause bias towards zero in measured velocity
![Page 73: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/73.jpg)
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
![Page 74: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/74.jpg)
ADCP ProcessingSingleping editing: acoustic interference
ADCP ProcessingSingleping editing: acoustic interference
![Page 75: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/75.jpg)
ADCP Processing: editing out interference
ADCP Processing: editing out interference
![Page 76: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/76.jpg)
ADCP Processing: editing out interference
ADCP Processing: editing out interference
![Page 77: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/77.jpg)
ADCP Processing without singleping editing
Averaged ocean velocities NOTE: along-track direction bias
ship directio
n
ADCP Processing without singleping editing
Averaged ocean velocities NOTE: along-track direction bias
ship directio
n
![Page 78: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/78.jpg)
ADCP Processing: acoustic interference
WITHOUT singleping editing
USING singleping editing
ADCP Processing: acoustic interference
WITHOUT singleping editing
USING singleping editing
![Page 79: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/79.jpg)
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
![Page 80: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/80.jpg)
single-ping editing:underway bias
single-ping editing:underway bias
![Page 81: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/81.jpg)
ADCP Data: effect of bubbles
Bubbles: - short profiles - strongly biased towards zero
Untreated: - biased ocean velocities
-8
-8
0
0
m/s
ADCP Data: effect of bubbles
Bubbles: - short profiles - strongly biased towards zero
Untreated: - biased ocean velocities
-8
-8
0
0
m/s
![Page 82: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/82.jpg)
met
ers
met
ers
met
ers
decimal day decimal day
NO single-ping editing AFTER single-ping editing
Acoustic Interference
Additional editingLower Percent Good
No effects left
Acoustic Interference
met
ers
met
ers
met
ers
decimal day decimal day
NO single-ping editing AFTER single-ping editing
Acoustic Interference
Additional editingLower Percent Good
No effects left
Acoustic Interference
![Page 83: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/83.jpg)
met
ers
met
ers
met
ers
decimal day decimal day
NO single-ping editing AFTER single-ping editing
Heavy seas = bubblesand underway bias
Heavy seas results in decreased Percent Good(instrument-level data loss)
Further reduction of Percent Goodby single-ping editing -- low PGshows reduced data content: usethresholds and manual editing
Single-ping editing removesmost of the biased data
Bubbles and alongtrack bias
met
ers
met
ers
met
ers
decimal day decimal day
NO single-ping editing AFTER single-ping editing
Heavy seas = bubblesand underway bias
Heavy seas results in decreased Percent Good(instrument-level data loss)
Further reduction of Percent Goodby single-ping editing -- low PGshows reduced data content: usethresholds and manual editing
Single-ping editing removesmost of the biased data
Bubbles and alongtrack bias
![Page 84: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/84.jpg)
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
ADCP Single-ping Editing
The most common causes of error (addressed by single-ping editing)
● Acoustic Interference● Bubbles● Below bottom
![Page 85: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/85.jpg)
Bottom Editing: - remove acoustic interference, identify maximum amplitude - calculate region of side-lobe interference - flag as BAD all data below the bottom or with side-lobe interference
Acoustic Interference
Bottom Bounce
Bottom Editing: - remove acoustic interference, identify maximum amplitude - calculate region of side-lobe interference - flag as BAD all data below the bottom or with side-lobe interference
Acoustic Interference
Bottom Bounce
![Page 86: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/86.jpg)
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
AFTER AVERAGING
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
AFTER AVERAGING
![Page 87: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/87.jpg)
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
UHDAS processing demo
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
UHDAS processing demo
![Page 88: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/88.jpg)
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
CODAS Postprocessing● Editing (single-ping)
● Acoustic interference● Bubbles● Below bottom
● Interpolate missing heading correction● Apply calibrations
● Rotation● Scale factor● Transducer offset (new)
● Manually edit CODAS database averages “gee-autoedit”
![Page 89: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/89.jpg)
CODAS Processing: Calibration● Calibration of averaged data:
● Cross-track error (angle error)– Incorrect transducer angle (constant)– Inaccurate heading (time-varying)
● Alongtrack bias (scale factor)– Soundspeed (single-ceramic transducers
only)● Transition Error
– Horizontal offset between GPS and ADCP
CODAS Processing: Calibration● Calibration of averaged data:
● Cross-track error (angle error)– Incorrect transducer angle (constant)– Inaccurate heading (time-varying)
● Alongtrack bias (scale factor)– Soundspeed (single-ceramic transducers
only)● Transition Error
– Horizontal offset between GPS and ADCP
![Page 90: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/90.jpg)
Calibration: Angle Error
Calibration: Angle Error
![Page 91: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/91.jpg)
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from ● Transducer angle (beam “3” clockwise from bow)● Heading of ship
● VmDAS,–“Primary” heading, often no QC message– If “Primary” fails, replace with “Secondary”
● UHDAS, –Reliable heading for each ping (eg gyro)–Heading correction for each averaging period–Calculated relative to devices such as Ashtech, POSMV, Seapath, Mahrs, Phins (hopefully with QC fields)
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from ● Transducer angle (beam “3” clockwise from bow)● Heading of ship
● VmDAS,–“Primary” heading, often no QC message– If “Primary” fails, replace with “Secondary”
● UHDAS, –Reliable heading for each ping (eg gyro)–Heading correction for each averaging period–Calculated relative to devices such as Ashtech, POSMV, Seapath, Mahrs, Phins (hopefully with QC fields)
![Page 92: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/92.jpg)
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from ● Transducer angle (beam “3” clockwise from bow)
This is a constant value for the whole cruiseExamples of error in transducer angle follow...
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from ● Transducer angle (beam “3” clockwise from bow)
This is a constant value for the whole cruiseExamples of error in transducer angle follow...
![Page 93: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/93.jpg)
Calibration: angle error -3.6deg
Calibration: angle error -3.6deg
![Page 94: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/94.jpg)
Calibration: angle error -1.6
Calibration: angle error -1.6
![Page 95: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/95.jpg)
Calibration: angle error 0.4
Calibration: angle error 0.4
![Page 96: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/96.jpg)
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from
Heading, which may be in error by● A constant offset● A time-dependent offset
Example follows ...
Symptom = Cross-Track ErrorCause = incorrect angle applied
Angle applied comes from
Heading, which may be in error by● A constant offset● A time-dependent offset
Example follows ...
![Page 97: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/97.jpg)
Phins-Gyro difference varies with time
0.5 deg
-0.5 deg0.0 deg
Changes in ship's heading affect heading error
0 deg
360 deg
Heading
Heading error
180 deg
Phins-Gyro difference varies with time
0.5 deg
-0.5 deg0.0 deg
Changes in ship's heading affect heading error
0 deg
360 deg
Heading
Heading error
180 deg
![Page 98: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/98.jpg)
0.5 deg
-0.5 deg0.0 deg
Changes in ship's heading affect heading error
Heading
Heading error
Effect of Time-Dependent Heading Erroron Ocean Velocties
1 degree error in heading means: – 0.1m/s error in ocean velocity – in the cross-track direction
0.5 deg
-0.5 deg0.0 deg
Changes in ship's heading affect heading error
Heading
Heading error
Effect of Time-Dependent Heading Erroron Ocean Velocties
1 degree error in heading means: – 0.1m/s error in ocean velocity – in the cross-track direction
![Page 99: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/99.jpg)
Is this a heading error?
Is this a heading error?
![Page 100: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/100.jpg)
Contour plot:
Is this cross-tracksignal(stripes in N/S ocean velocity)due to a heading error?
Contour plot:
Is this cross-tracksignal(stripes in N/S ocean velocity)due to a heading error?
![Page 101: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/101.jpg)
Answer
Actually, it's really the ocean, butwe can't tell without knowing
the quality of the accurate heading device.
Answer
Actually, it's really the ocean, butwe can't tell without knowing
the quality of the accurate heading device.
![Page 102: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/102.jpg)
Examples of along-track error
Remove during single-ping editing● Acoustic interference● Bubbles (underway bias)Correct after averaging:● Scale factor (NB150 soundspeed correction)
Examples of along-track error
Remove during single-ping editing● Acoustic interference● Bubbles (underway bias)Correct after averaging:● Scale factor (NB150 soundspeed correction)
![Page 103: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/103.jpg)
Calibration: scale factor (alongtrack bias)
Calibration: scale factor (alongtrack bias)
![Page 104: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/104.jpg)
Calibration: ADCP-GPS offset
(1) Cross-track error:– recovery requires accurate heading
(2) Along-track error:– may indicate a serious problem– recovery may be possible, incomplete,
ambiguous
(3) Transition/maneuvering error– Lag or offset in time or space
Calibration: ADCP-GPS offset
(1) Cross-track error:– recovery requires accurate heading
(2) Along-track error:– may indicate a serious problem– recovery may be possible, incomplete,
ambiguous
(3) Transition/maneuvering error– Lag or offset in time or space
![Page 105: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/105.jpg)
Example: offset between ADCP and GPS creates an artifact during maneuvering
Example: offset between ADCP and GPS creates an artifact during maneuvering
![Page 106: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/106.jpg)
Transducer offset from GPS--error occurs: transition between on-station and underway
heading speed
...using actuallocation
...using shifted GPSlocation
difference
Transducer offset from GPS--error occurs: transition between on-station and underway
heading speed
...using actuallocation
...using shifted GPSlocation
difference
![Page 107: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/107.jpg)
Manual Editing
● Bottom interference● Wire interference● Scattering layers● Ringing● Bad shallow PG and underway bias
(see GeeAutoedit documentation)
Manual Editing
● Bottom interference● Wire interference● Scattering layers● Ringing● Bad shallow PG and underway bias
(see GeeAutoedit documentation)
![Page 108: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/108.jpg)
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
OutlineDay 1: Morning: Presentation 1. ADCP: components to currents 2. ADCP Data Acquisition
- compare: VmDAS UHDAS 3. CODAS Processing 4. Data Stewardship
After: Practice
![Page 109: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/109.jpg)
Another break?
Another break?
![Page 110: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/110.jpg)
UHDAS Shipboard ADCP Data (Raising the Profile of Ocean Currents)
UHDAS Data Archiving and Stewardship
UHDAS Shipboard ADCP Data (Raising the Profile of Ocean Currents)
UHDAS Data Archiving and Stewardship
![Page 111: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/111.jpg)
Who uses ocean currents from Shipboard ADCP?
At Sea:● near-realtime guidance for sampling
● “are we inside or outside the eddy” ● “did we cross the front yet?”● “where do we find the zooplankton?”
● preliminary calculations for science● characterize data based on flow regime
● operationally● aid in dynamic sampling strategy● predict trajectory of drifting objects● towing, over-the-side work, dive operations
Who uses ocean currents from Shipboard ADCP?
At Sea:● near-realtime guidance for sampling
● “are we inside or outside the eddy” ● “did we cross the front yet?”● “where do we find the zooplankton?”
● preliminary calculations for science● characterize data based on flow regime
● operationally● aid in dynamic sampling strategy● predict trajectory of drifting objects● towing, over-the-side work, dive operations
![Page 112: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/112.jpg)
LATMIX
LATMIX
![Page 113: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/113.jpg)
Post-Cruise Analysis:● Look in detail (calculations or context) for one
cruise● apply calibrations, edit; reprocess if problems are found
● Climatology/Time-series using multiple cruises● requires multiple datasets that are already finalized ● project-based example:
– instrumented Volunteer Observing Ship (eg. Oleander)– Drake Passage crossings to Antarctica (L.M.Gould)
● opportunistic example:– Pacific Equatorial currents (many ships, eg TAO buoy service)
Who uses ocean currents from Shipboard ADCP?
Post-Cruise Analysis:● Look in detail (calculations or context) for one
cruise● apply calibrations, edit; reprocess if problems are found
● Climatology/Time-series using multiple cruises● requires multiple datasets that are already finalized ● project-based example:
– instrumented Volunteer Observing Ship (eg. Oleander)– Drake Passage crossings to Antarctica (L.M.Gould)
● opportunistic example:– Pacific Equatorial currents (many ships, eg TAO buoy service)
Who uses ocean currents from Shipboard ADCP?
![Page 114: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/114.jpg)
(2) What does UHDAS do?
Performs these tasks:● Data acquisition● Data processing (create ocean currents)● Generates data products (multiple formats)● Generates tools and components for monitoring
(at sea and on shore)
(2) What does UHDAS do?
Performs these tasks:● Data acquisition● Data processing (create ocean currents)● Generates data products (multiple formats)● Generates tools and components for monitoring
(at sea and on shore)
![Page 115: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/115.jpg)
What are our data goals?● Data should be as close to "final" as possible (for an automated system)
● Data should be useful for science and operations at sea
● Require minimal post-processing for science● Enhance the utility and visibility of ADCP data● Open Source code, clear documentation ● Reprocessing on multiple operating systems (Linux, Mac, Windows)
What are our data goals?● Data should be as close to "final" as possible (for an automated system)
● Data should be useful for science and operations at sea
● Require minimal post-processing for science● Enhance the utility and visibility of ADCP data● Open Source code, clear documentation ● Reprocessing on multiple operating systems (Linux, Mac, Windows)
![Page 116: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/116.jpg)
(3) Data benefits of UHDAS
● Remote monitoring by ADCP guru:● ensure good configurations, reasonable settings● catch problems early
● Long-term usefulness:● Open source software● Existing path to NCEI
● Open communication with scientists and techs
(3) Data benefits of UHDAS
● Remote monitoring by ADCP guru:● ensure good configurations, reasonable settings● catch problems early
● Long-term usefulness:● Open source software● Existing path to NCEI
● Open communication with scientists and techs
![Page 117: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/117.jpg)
Typical UHDAS dataset sizes
Original data from instruments, logged by UHDAS
(intermediatestages)
automatedprocessing- directories- products
ADCP data submission from a cruise
● Full at-sea directory (eg. month-long cruise) 5Gb● Subset necessary to completely reprocess 4Gb● Final averaged data product for scientists 25Mb
nuggets for science use/evaluationplots: diagnostic, sciencelogs: evaluation, calibrationdata: ocean currents
Typical UHDAS dataset sizes
Original data from instruments, logged by UHDAS
(intermediatestages)
automatedprocessing- directories- products
ADCP data submission from a cruise
● Full at-sea directory (eg. month-long cruise) 5Gb● Subset necessary to completely reprocess 4Gb● Final averaged data product for scientists 25Mb
nuggets for science use/evaluationplots: diagnostic, sciencelogs: evaluation, calibrationdata: ocean currents
![Page 118: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/118.jpg)
(4) Archiving, Serving, Stewardship
● diagram of information flow● JASADCP – long-term archive for finalized
shipboard ADCP data
● UHDAS, R2R, and NEIC● historical data to JASADCP● mine historical data for low-hanging fruit, other uses
PAST and PRESENT
PRESENT and FUTURE
(4) Archiving, Serving, Stewardship
● diagram of information flow● JASADCP – long-term archive for finalized
shipboard ADCP data
● UHDAS, R2R, and NEIC● historical data to JASADCP● mine historical data for low-hanging fruit, other uses
PAST and PRESENT
PRESENT and FUTURE
![Page 119: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/119.jpg)
Flow of informationOld Model
cruise Chief Scientist papers,
pubs,results
original
data
processed
data
Other people●can read about the results●cannot use the data (or must get it from Chief Scientist)
Flow of informationOld Model
cruise Chief Scientist papers,
pubs,results
original
data
processed
data
Other people●can read about the results●cannot use the data (or must get it from Chief Scientist)
![Page 120: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/120.jpg)
Flow of informationPast and Present
cruise Chief Scientist papers,
pubs,results
original
data
processed
ADCP data
created 1992: Joint Archive for Shipboard ADCP ●centralized dissemination center processed (finalized) shipboard ADCP data
●anyone can access standardized, science-ready data
JASADCP publicaccess
Flow of informationPast and Present
cruise Chief Scientist papers,
pubs,results
original
data
processed
ADCP data
created 1992: Joint Archive for Shipboard ADCP ●centralized dissemination center processed (finalized) shipboard ADCP data
●anyone can access standardized, science-ready data
JASADCP publicaccess
![Page 121: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/121.jpg)
Joint Archive for Shipboard ADCP● accepts science-ready ocean current data
● over 800 cruises (multiple instruments on some ships)● from multiple countries, multiple acquisition systems● this represents only a small fraction of historical data
● regularly used by scientists from 1992 - present● (new) higher-resolution data available now/soon
Joint Archive for Shipboard ADCP● accepts science-ready ocean current data
● over 800 cruises (multiple instruments on some ships)● from multiple countries, multiple acquisition systems● this represents only a small fraction of historical data
● regularly used by scientists from 1992 - present● (new) higher-resolution data available now/soon
![Page 122: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/122.jpg)
JASDCP and UHDAS
Finalize processingthen submit to JASADCPUHDAS data directory from a cruise
JASADCP publicaccess
JASDCP and UHDAS
Finalize processingthen submit to JASADCPUHDAS data directory from a cruise
JASADCP publicaccess
![Page 123: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/123.jpg)
NCEI: archiving UHDAS datasets● UNOLS cruises
– ship submits to R2R (http://www.rvdata.us/catalog)– R2R adds value, pushes to archive to NCEI
● NCEI creates data accession● cruises under NCEI
Global Ocean Currents Database● “originator data” R2R shipboard ADCP (507 cruises)● UHDAS group: work with NOAA to
● get UHDAS ADCP data from NOAA ships into NCEI● improve discovery and use of archived datasets
NCEI: archiving UHDAS datasets● UNOLS cruises
– ship submits to R2R (http://www.rvdata.us/catalog)– R2R adds value, pushes to archive to NCEI
● NCEI creates data accession● cruises under NCEI
Global Ocean Currents Database● “originator data” R2R shipboard ADCP (507 cruises)● UHDAS group: work with NOAA to
● get UHDAS ADCP data from NOAA ships into NCEI● improve discovery and use of archived datasets
![Page 124: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/124.jpg)
Present and Future: - two paths to finalized public data - more opportunities for original data to be used
cruise
R2R
NCEI A.N.Other (Scientist) papers,
pubs,results
Chief Scientist papers,
pubs,results
original
data
processed
data
JASADCP publicaccess,finalizeddata
discovery
Present and Future: - two paths to finalized public data - more opportunities for original data to be used
cruise
R2R
NCEI A.N.Other (Scientist) papers,
pubs,results
Chief Scientist papers,
pubs,results
original
data
processed
data
JASADCP publicaccess,finalizeddata
discovery
![Page 125: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/125.jpg)
Summary: What We Did
1. ADCP instrument● What it is; getting ocean velocities
2. ADCP Data Acquisition● Acquisition, processing, monitoring● Comparison: UHDAS VmDAS● UHDAS data details
3. CODAS Processing ● Single-ping editing● Postprocessing
● Calibration● Editing
4. Data Stewardship (more discovery, more recovery)
Summary: What We Did
1. ADCP instrument● What it is; getting ocean velocities
2. ADCP Data Acquisition● Acquisition, processing, monitoring● Comparison: UHDAS VmDAS● UHDAS data details
3. CODAS Processing ● Single-ping editing● Postprocessing
● Calibration● Editing
4. Data Stewardship (more discovery, more recovery)
![Page 126: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/126.jpg)
ADCP: Getting Ocean Currents
Summary of steps:
Doppler to beam (not shown)
below here: horizontal+vertical
● beam to instrument ● instrument to ship● ship to earth
ADCP: Getting Ocean Currents
Summary of steps:
Doppler to beam (not shown)
below here: horizontal+vertical
● beam to instrument ● instrument to ship● ship to earth
![Page 127: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/127.jpg)
beam velocities
+
transducer orientation +
heading
+gps
ocean velocities
ADCP: Data components
ADCP
attitude
position
(processing)
calibration
beam velocities
+
transducer orientation +
heading
+gps
ocean velocities
ADCP: Data components
ADCP
attitude
position
(processing)
calibration
![Page 128: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/128.jpg)
![Page 129: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/129.jpg)
UHDAS cruise directory structure
(link in documentation – [raw+rbin+gbin] directories)
CODAS PROCESSING
UHDAS cruise directory structure
(link in documentation – [raw+rbin+gbin] directories)
CODAS PROCESSING
![Page 130: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/130.jpg)
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
CODAS ProcessingTime, ADCP,Position,Attitude
primitive (raw) data
![Page 131: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/131.jpg)
Present and Future: - two paths to finalized public data - more opportunities for original data to be used
cruise
R2R
NCEI A.N.Other (Scientist) papers,
pubs,results
Chief Scientist papers,
pubs,results
original
data
processed
data
JASADCP publicaccess,finalizeddata
discovery
Present and Future: - two paths to finalized public data - more opportunities for original data to be used
cruise
R2R
NCEI A.N.Other (Scientist) papers,
pubs,results
Chief Scientist papers,
pubs,results
original
data
processed
data
JASADCP publicaccess,finalizeddata
discovery
![Page 132: Shipboard ADCP processing workshop Feb 18, 2018 University of … · 2018-02-19 · Shipboard ADCP processing workshop Feb 18, 2018 University of Alaska, Fairbanks UHDAS ADCP data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ecad115598f8628467420a4/html5/thumbnails/132.jpg)
Workshop: What We Will Do1. ADCP instrument
● What it is; getting ocean velocities2. ADCP Data Acquisition
● Acquisition, processing, monitoring
● Comparison: UHDAS VmDAS● UHDAS data details
3. CODAS Processing ● Single-ping editing● Postprocessing
● Calibration● Editing
4. Data Stewardship
Day 1afternoon
Day 2Day 3
Workshop: What We Will Do1. ADCP instrument
● What it is; getting ocean velocities2. ADCP Data Acquisition
● Acquisition, processing, monitoring
● Comparison: UHDAS VmDAS● UHDAS data details
3. CODAS Processing ● Single-ping editing● Postprocessing
● Calibration● Editing
4. Data Stewardship
Day 1afternoon
Day 2Day 3