USGS Home Contact USGS Search USGS

sw_dvs_not_on_web

Name:
sw_dvs_not_on_web - Find surface-water related daily value statistics stored in primary, official-record, DD's that are not being published on NWISWeb.

Information:

Sw_dvs_not_on_web is a review tool that scans an entire NWIS database and the NWISWeb website for surface water-related DV's stored under primary, "official-record", DDs that are not published on NWISWeb. Data stored under an "official-record", primary, DD should generally be considered to be of publication quality and should be published on the NWISWeb website and made available for widespread use by all NWISWeb users. If stored data are not of publication-quality, they should not be stored in a primary DD and should either be deleted or moved to a different working DD (or the primary DD can be toggled to working if no official record is stored in it). Station descriptions, previous data report series, and local documentation and knowledge of the station will likely need to be reviewed to determine whether data are fully vetted for publication or not, prior to taking action to address the data.

If data are found to be fully vetted for publication, the nw_edit program should be used to add the data to the public NWISWeb display.

If data are found to be "bad" and of little value, they should be deleted from the DD. Several utilities to assist with the deletion of individual statistics from historical records while by-passing normal ADAPS data-aging rules has been developed by NWIS and are available from the OSW_Scripts website. DV_cleanup, stop_maxmin_q_processing, and stop_mean_stage_processing should prove very useful and save considerable time with this cleanup.

If data are found to be questionable and may be of some use or may have been used within a project report, etc. but aren't verified to have been fully vetted for publication, data can be moved out of the primary DD and into a different working DD using the copy_dv_to_diff_dd script available from the OSW_Scripts website. An appropriate DD description can be added to the DD to indicate the status of the data. This should help prevent it from accidentally being published in the future.

Script currently restricts it's search to the following parameters:
00045 Precipitation, total, inches
00060 Discharge, cubic feet per second
30208 Discharge, cubic meters per second
80154 Suspended sediment concentration, milligrams per liter
80155 Suspended sediment discharge, tons per day

Output consists of listings of DD's and daily statistics not currently being served on NWISweb, followed by reference listings of all daily value statistics currently being published on NWISweb and all daily value statistics stored in the current primary WSC database for the parameter codes above.

Usage:

Simply type "sw_dvs_not_on_web" and output will be placed in the directory where run with the output filename indicated on the screen.

Sample Output:

sw_dvs_not_on_web output produced Thu Jan 31 11:07:26 MST 2013 by walker

Original filename = nwisco_sw_dvs_not_on_web.txt


DVs found to be missing from NWISWeb should be verified as good, quality controlled data and added
 to NWISWeb as appropriate.

If data are not quality controlled and of little value, they should be deleted from the DD.
If data are questionable or of only minor value, they should be moved to a working DD with an appropriate
DD description so that data can be better identified as questionable or marginally useful data.


THE FOLLOWING DAILY SEDIMENT CONCENTRATION DATA DO NOT APPEAR TO BE ON NWISWEB:
8 stations/DDs/stats detected
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06704500           23  00003  Y        80154       319             0         36.45  18-OCT-1994   29-SEP-1997
THE FOLLOWING DAILY SEDIMENT LOAD DATA DO NOT APPEAR TO BE ON NWISWEB:
26 stations/DDs/stats detected
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06704500           24  00003  Y        80155      1096             0         4.216  01-OCT-1994   30-SEP-1997


THE FOLLOWING DAILY WATER DISCHARGE DATA DO NOT APPEAR TO BE ON NWISWEB:
713 stations/DDs/stats detected
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06060606           20  00003  Y        00060       721            23      100378.6  11-APR-2000   06-SEP-2011 



THE FOLLOWING DAILY PRECIPITATION DATA DO NOT APPEAR TO BE ON NWISWEB:
205 stations/DDs/stats detected
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06700000           13  00006  Y        00045      3008             0        164.24  22-MAY-2003   30-JAN-2013 


The following sections are for reference and are what the above output was based on:

THE FOLLOWING DAILY SEDIMENT CONCENTRATION DATA ARE CURRENTLY BEING SERVED ON NWISWEB:
Agncy  site_no          dd_nu  stat_cd
-----  ---------------  ----  -----
USGS   06619400         04    00003


THE FOLLOWING DAILY SEDIMENT LOAD DATA ARE CURRENTLY BEING SERVED ON NWISWEB:
Agncy  site_no          dd_nu  stat_cd
-----  ---------------  ----  -----
USGS   06619400         05    00003


THE FOLLOWING DAILY WATER DISCHARGE DATA ARE CURRENTLY BEING SERVED ON NWISWEB:
Agncy  site_no          dd_nu  stat_cd
-----  ---------------  ----  -----
USGS   06611000         01    00003


THE FOLLOWING DAILY PRECIPITATION DATA ARE CURRENTLY BEING SERVED ON NWISWEB:
Agncy  site_no          dd_nu  stat_cd
-----  ---------------  ----  -----
USGS   06704500         03    00006


THE FOLLOWING DAILY SEDIMENT CONCENTRATION DATA ARE STORED IN THE DATABASE:
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06619400            4  00003  Y        80154      1013             1           139  23-MAY-1978   30-SEP-1983 


THE FOLLOWING DAILY SEDIMENT LOAD DATA ARE STORED IN THE DATABASE:
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06619400            5  00003  Y        80155      1504          0.02            84  23-MAY-1978   30-SEP-1983 


THE FOLLOWING DAILY WATER DISCHARGE DATA ARE STORED IN THE DATABASE:
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06060606           20  00003  Y        00060       721            23      100378.6  11-APR-2000   06-SEP-2011 


THE FOLLOWING DAILY PRECIPITATION DATA ARE STORED IN THE DATABASE:
Agency  Station            DD  Stat   Primary  Parm      Ndays          From            To  Begins        Ends
------  ---------------  ----  -----  -------  -----  --------  ------------  ------------  ------------  ------------
USGS    06060606           20  00003  Y        00060       721            23      100378.6  11-APR-2000   06-SEP-2011 

Note that output above is greatly abbreviated.

Installation:
The scripts can be installed by unzipping the files in any Sun directory and making sure the script is executable (chmod +x sw_dvs_not_on_web).

Script Language:
ksh

Requirements:

• NWIS 5.0 or higher

Original Author(s): Wade Walker, Colorado WSC

Note the original author is noted on this page for the purposes of giving credit only. Please address questions/comments to OSW (GS-W OSW Scripts@usgs.gov).

Scripts:

Version 5.0: (Posted 02/01/2013)
—Initial release under NWIS 5.0

sw_dvs_not_on_web download (Zip file = 3.7K)

USGS Home Water Resources Biology Geography Geology Geospatial