exview: a real-time experiment browser used for sw06 cruise collaboration andrew maffei, steve...
TRANSCRIPT
ExView: A Real-time Experiment Browser used for SW06 Cruise Collaboration
Andrew Maffei, Steve Lerner, Art Newhall, Cindy Sellers, Laura Stolp, John Kemp, Jim Akens (WHOI)Scott Glenn and team (Rutgers)SW06 Meeting, San DiegoJanuary 31, 2006
SW06 Logistics App. Goals Help to make sure vehicles don’t run over moorings or
each other. Provide a common view for all participants of a multi-
disciplinary, multi-vehicle, multi-PI experiment. Provide a way to distribute Internet-based information to all
ships (even those without SATCOM) Provide a way to easily communicate information between
ships Provide a way for shore and ship based staff to monitor
experiment status. Provide a historical archive of experiment that can be built
upon during post-experiment collaboration
ExView: How we did it Latte as prototype ExView: Custom webapp built for this experiment
(using WHOI 4DGeoBrowser Tech) Shore-based webserver mining Internet resources Dedicated, synchronized laptops, hosting a
mirrored website, was installed on each ship Ship wireless network using SATCOM and WiFi Supportive science and shipboard staff during design
and implementation Dedicated support staff on shore during ops Luck
ExView Main Screen Features
•Logistics Map
•Integrated Logistics Data
•Cruise Archive
•Date/Time Browsing
•Environmental Data
•Map Display
•Ship/Glider Tracks
•Mooring Locations
•Report Viewers & Summaries
•New: Integration of post-cruisedata products and views for data analysis purposes
ExView Daily Reports
ExView Daily Reports
17 apps at 4dgeo.whoi.edu
Synchronized Laptops Refurbished, “cookie-cutter” laptops that
are easily replaced when they fail. Linux, Apache, Rsync are workhorses 2 Ethernet connections for each laptop
Installed SWAP and Serial/Ethernet converters (for GPS) where necessary
Configured rsync in a restricted manner All directories have only one author
Shore ExView: Cgi-bin, html, and data directories Ship ExView: toshore/from-oceanus, toshore/from-
knorr, … No files deleted
RSYNC IS SIMPLY MAGIC
SW06 wireless data network
Comm Technology
Disruption Characteristics
Link Speed
Knorr HiSeasNet ( C )
~93% up (good antenna location)
180Kbps down, 96Kbps up(shared w Atlantis, SJ)
Endeavor HiSeasNet (Ku)
~50% (heading and weather dependent)
128Kbps up/down(shared w New Horizon)
RVTEC SWAP Within 7nm. when antennas in sight of one another
2-11Mbps
Shipboard LAN
24x7 10/100 Mbps
1.5 Gbytes in 3 months = 1550bps
Dedicated Support Staff Cindy Sellers on shore Steve and Andy as backup Hand holding of information suppliers
and ship/shore information viewers Noticed when things did not seem to be
going quite right (from science perspective)
Provided sense of humor and a positive attitude
Luck SWAP stayed up on site even though
there were many problems with it at dock
2 HiSeasNet ships meant connectivity to Internet was usually available via one or other
Rsync better than we expected No huge files were sent during SW06
(we discouraged its use for data files -- send matlab plots instead!)
Accomplishments and Lessons Learned All goals met. Exceeded our own
expectations in areas of reliability, participant involvement, and effort required to maintain
Daily Reports for file transfers might be cumbersome but works well for reducing bandwidth used and increasing average information content transferred.
Synchronized “laptop-websites” work well on UNOLS vessels and are much easier to implement that we thought before SW06.
SW06 Post-cruise
Realtime* and Post-cruise Data Samples
Category Source Format Sampling Rate
Total Size (local only)
Views
Shiptracks Ships Text 1/min 73M Main/map
DailyReports Rutgers, Ships
PPT, Webform
1/day 269M Dailyreport View
Weather Reports
NOAA Website
Image/Text 6/day 252M Weather View
CODAR/SST Rutgers Image/Text 1/hr 507M CODAR View
Satellite/Radar
Miami Image/Text Variable 37M Satellite Image View
GliderTracksand data imgs
Rutgers Image/Text Variable 272M Glider View (WIP)
Engineering Data (wireless comms, etc.)
WHOI, Ships Text Variable ? WIP
Shru WHOI Image, Audio 1/min 39G(raw = TB)
Shru3 & Multi-Shru View (WIP)
Shark WHOI Image, Audio 1/min ? Shark View (WIP)
Available ExView ViewsName Data Displayed Widgets Status
Main View Map, Events/Text ClickableMap, EventList, CalTime
In Exview
Daily Reports Images/Text CalTime In ExView
Weather Viewer SatImagge/Text CalTime In ExView
Glider Viewer DataImages/Text CalTime In ExView(under devel)
Satellite Image Viewer SatImages/Text CalTime In ExView
Shipboard Wireless Engineering Display
RtData, Text None In ExView
SHRU Display Images/Text, Audio, Environmental Ship Data, Annotations
Map, CalTiime, VCR Buttons, TempTimeBar, Image Annotation, Audio Clips, Image Composites
In ExView(under devel)
Multi-SHRU Display Images/Audio/Text TBD Under devel
Shark Display TBD TBD Under devel
SHRUView Integrated Info and Widgets
•Spectrograms
•Audio Files (Play/Download)
•Temperature Profiles
•Clickable Temp TimeBar
•Calendar/Time Search
•Environmental Data
•IMET (KNR, OCE)
•Add/View Interpretations
•Map Display
•Ship/Glider Tracks
•Mooring Locations
Post-cruise Interpretations
Other Candidate Views?Name Data Displayed Widgets Status/Comments
PO Mooring Data View TBD TBD
Ship Data (IMET) View TBD TBD
Predicted Sound Speed Profile View
TBD TBD
ASISView TBD TBD
StratView TBD TBD
Journal Article Viewer TBD TBD
Scanfish View TBD TBD
Model View TBD TBD
……..
Steps for creating ExView views for your data products
Spend 2 hours white-boarding with us Iterate on view layout via email and conference
call on a mockup of the view design with us We provide you with time estimate based on
design complexity,new widgets required, etc. We establish on image format, plotting and model
parameters, filename, etc. conventions to be used.
You create data products (typically graphic images) and make them available on your server.
We build new view and incorporate it into ExView
http://sealion.whoi.edu/om-bin/ge_sw06.kml
Future work Publish a paper describing role of ExView in
SW06 and examine SW06 experiment in context of planned national ocean observatory needs/efforts underway.
Build viewers for interested PIs so that their data products can be integrated into ExView.
More tightly associate various ExView views (using overlays, dhtml, etc.)
Work w NSF to incorporate ExView and SWAP2 as standard on UNOLS vessels
Integrate Google Earth more fully into ExView
Thanks to you all. You were great to work with. WHOI ExView Team
Jim Akens, John Kemp, Steve Lerner, Jim Lynch, Andy Maffei, Art Newhall, Cindy Sellers, Laura Stolp, Barrie Walden
COOL Lab - Scott Glenn and his whole team Shipboard Technical Staffmembers and crew
- Udel, URI, WHOI, Quest SW06 - All participants for their patience,
helpful suggestions, willingness to contribute.
Extra Slides
Building ShruViewStep Who What
1 Art Sampled binary data from SHRUs and run post-processing task to determine data quality and best way to create images and audio
2 Art, Steve, Andy
Used whiteboard to compose new ExView View that incorporated pre-existing and new information sources, and “widgets” from existing ExView Toolbox into an *expert* view of this information
3 ASA Determined required information sources for SHRU View: 1-min Spectograms (new), 1-min soundfiles (new), Watertemp plots (new), ship Env Data (existing), platform locations (existing)
4 ASA Determined widgets for SHRUView: SW06LogisticsMap, CalTIme Browser, SpectrogramAnnotation widget (derived from pre-existing similar tool), WaterTempBrowsing widget (new)
5 Steve Review initial data products created in 1 and suggest image/audio processing parameters that will help products work best in ExView
6 Art Steve
Agree on conventions for filenaming, plot axes, image resolution, audio file size/duration, etc. that will work best for both scientific analysis and ExView performance.
7 Art Builds all spectograms, tempprofiles, and audiofiles from SHRU data and makes available on his webserver
8 Steve Builds SHRU View and incorporates into ExView application environment
What might a POMooringView Look Like?