NDBC Data Management of IOOS Data

NDBC Data Management of IOOS Data

NDBC Data Management of IOOS Data Dawn Petraitis, Kevin Kern, and Shannon McArthur National Data Buoy Center Stennis Space Center, MS May 24, 2017 Summary of Topics

Data flow from IOOS data provider to NDBC and GTS Measurements accepted by NDBC Station IDs NDBC XML format Quality Control overview GTS format

Historical data Future work How does data flow from IOOS to NDBC? Measurements accepted by NDBC Meteorological Winds (direction, speed, gust), air temperature, dew

point, relative humidity, barometer, sea surface temperature, wave height, dominant period, mean wave direction, short wave and long wave radiation Oceanographic Sub-surface water temperature and salinity (30 depths) Ocean currents (70 depths/bins)

Dissolved oxygen (near surface and near bottom), turbidity, chlorophyll, tides, pH, EH Waves Directional and non-directional (bulk and spectral) What is needed to send data to NDBC?

Location, station name, and list of measurements Station ID assigned by NDBC Moored buoys and coastal stations require different IDs

FTP account assigned by NDBC Data will be automatically pushed to comms.ndbc.noaa.gov XML format message XML tags to be included will depend on data sent to NDBC

Assignment of Station IDs Moored buoys require a 5-digit WMO ID ID is region-specific Land-based fixed stations require a 5- character alpha-numeric ID ID is from the NWS Location Identifier system Each state has a specific code

All station IDs are assigned by NDBC when we are notified of a new station by the RA/operator Unique IDs are important for distribution on the GTS

XML Format Tags - Met XML Format Tags - Ocean XML Format Tags - TESAC XML Format Tags - Supplemental

XML Format Tags - Missing XML Format Tags Spectral Wave XML Format Tags Spectral Wave Missing XML Message Example Met and Ocean

XML Message Example Spectral Wave Non-directional XML Message Example Spectral Wave Directional

Quality Control of IOOS Data All data is run through automated QC upon receipt NDBC runs QARTOD checks Automated QC Handbook available on NDBC website

http://www.ndbc.noaa.gov/NDBCHandbookofA utomatedDataQualityControl2009.pdf Lists the algorithms used and all flags GTS bulletins are generated after auto QC is complete

Auto QC Flags Hard flags stop data from being distributed on GTS and web Auto QC Flags Soft flags are an

advisory to the data analyst Do not stop data from being distributed Manual Quality Control

NDBC Mission Control Center performs manual QC on a daily basis Reviews all met, wave, and ocean data Report on all daily QC activities sent to partners

Available on NDBC website: http://www.ndbc.noaa.gov/pstat.shtml GTS Data Three types of GTS messages Met, Wave, and Temp/Salinity/Ocean Currents (TESAC)

No limit on frequency to the GTS Some NDBC stations now sending data every 10 minutes Bio/geo/chemical data (oxygen, chlorophyll, pH, etc.) not sent out via GTS

GTS distributes data for use by weather and ocean models and forecasters Other Methods of Data Distribution All data sent to NDBC is displayed on website in real time Tabular ASCII text and graphical format

NetCDF format available on our DODS server http://dods.ndbc.noaa.gov/ Historical Data NDBC does not archive IOOS data with NCEI Maintain historical data records on our

website and on DODS server IOOS Data Availability NDBC sends report to RAs each month Represents the percent of hours each month that an IOOS station reports data to the GTS

Internal reports for message counts and data availability Future Work Change from 5-digit WMO IDs to 7-digit WMO IDs for GTS BUFR format Will not require new WMO IDs for existing

stations Distribute data in BUFR format on GTS BUFR format allows for more metadata Will not change what variables are distributed on GTS unless a new template is released Data Quality Improvement Project

Review our auto and manual QC procedures Work with IOOS Program Office to better quantify the volume of IOOS observations going to the GTS

Recently Viewed Presentations

  • Targeting the Reservoir: Towards Therapies for Persistent HIV ...

    Targeting the Reservoir: Towards Therapies for Persistent HIV ...

    Approaches to persistent provirus HDAC inhibitors, other epigenetic drugs Combination therapies to induce expression and cell death Oncology paradigm and paradox Nancy Archin Kara Keedy Manzoor Cheema Daniel Parker Robbie Sackmann Kriston Barton Shailesh Choudhary Mike Cohen Joe Eron &...
  • What am I learning?  How to write equations

    What am I learning? How to write equations

    In the case of slope-intercept form y=mx+b, understand that if an equation were given in the form of y=b+mx would have the same value (b would still represent the y-intercept, and mx would still represent the coefficient multiplied by x)....
  • Prevention of Sexual Harassment in the Workplace

    Prevention of Sexual Harassment in the Workplace

    City of Boca Raton 1998 Burlington Industries, Inc. v. Ellerth 1998 Quid Pro Quo Hostile Work Environment Quid Pro Quo sexual harassment occurs when: Employment decisions or expectations-hiring decisions, promotions, salary increases, work assignments or performance evaluations are based on...
  • Tercera semana del desarrollo embrionario

    Tercera semana del desarrollo embrionario

    Gastrulación: formación de las capas germinativas. Proceso de transformación del disco bilaminar a trilaminar. Representa el inicio de la morfogénesis y es el fenómeno más importante que ocurre durante la tercera semana, en esta etapa se le denomina al embrión...
  • Non-Mendelian Genetics - I.S. 234

    Non-Mendelian Genetics - I.S. 234

    People with blood group 0 are called "universal donors" and people with blood group AB are called "universal receivers." When several genes affect a character, it is called a polygenic character. eye color is affected by several genes. One gene...
  • Adjective Phrases & Adverb Phrases

    Adjective Phrases & Adverb Phrases

    Phrases 7th Grade Chapter 14 Prepositional Phrases: Adjective and Adverb Phrases Pages 404-409 What is a Phrase? A phrase is a group of related words that is used as a single part of speech and that does not contain both...
  • Conflict resolution - II

    Conflict resolution - II

    Hawk-Dove-Bourgeouis n-person, continuous strategy competitions Game theory Economic vs evolutionary game theory Economic games are zero-sum, i.e. increasing the payoff to one player decreases the payoff to others. Evolutionary games need not be zero-sum. Economic games use money as currency...
  • Chapter 1

    Chapter 1

    Talk about Adam Smith and the Wealth of Nations. Note that this book was the first systematic attempt to address this big question and that economists have been trying to answer it ever since. You might like to mention that...