Link to USGS home

Thresh.scan

Name:
Thresh.scan - Create summary reports of threshold settings on publicly displayed DD's and indicate non-discharge DD's without critical threshold settings

Information:

NWISWeb has an automatically updated and web accessible report for each NWIS host of the usage of threshold settings for screening spikes from the web. This script downloads that report for a given NWIS host, shows actual threshold settings on all publicly viewable DD's (so users can check for inappropriate settings), pulls threshold settings from the NWIS database for any parameter code 72192 input DD's associated with displayed parameter code 00045 output DD's (a change made in NWIS 4.10 added those input DD's), and assigns critical warnings to any non-discharge, publically-accessible data descriptors missing very-high or very-low thresholds, which are required to be set as specified in http://water.usgs.gov/admin/memo/policy/wrdpolicy99.34.html and http://water.usgs.gov/admin/memo/SW/OSW_2006-01_Revised_02122010.pdf (note that very high/low thresholds are preferable to rapid increase/decrease thresholds as multiple high/low values may be missed by very rapid increase/decrease thresholds and they may also screen good data once the values return to normal).

A summary report showing all DD's and their threshold settings and an abbreviated report showing only DD's lacking critical very high/low thresholds are stored in the users current working directory.

Usage:

The current version must be run on the nwis host the reports are to be produced for.

Example host .All.Thresh.Rpt Report:

All Threshold Report for mywscserver
Tue Nov 29 12:48:23 MST 2011
(Based on DDs configured for display on NWISWeb.)

See http://water.usgs.gov/admin/memo/policy/wrdpolicy99.34.html and 
http://water.usgs.gov/admin/memo/SW/OSW_2006-01_Revised_02122010.pdf for more information on thresholds 
including why they're important and appropriate settings.

  * denotes input precip DD to publically accessible 00045 precip DD - thresholds can be set on either DD.
    Critical warnings will only be given if neither DD has both very high and very low thresholds set.

Station         DD      PARM    VHIG    VLOW    VRIN    VRDC

01234567        03      00065   7.00    0.10    !!!!    !!!!    
01234568        05      00065   10.00   !!!!    15.00   15.00   <--CRITICAL WARNING
00000001        02      00065   12.00   .01     15.00   15.00   
00000001        13      00045   !!!!    !!!!    !!!!    !!!!    <--CRITICAL WARNING
00000001        14      72192*  !!!!    !!!!    1.00    !!!!    
00000002        01      00065   10.00   .01     15.00   15.00   
00000002        03      00045   !!!!    !!!!    !!!!    !!!!
00000002        17      72192*  20.00   -.01    1.00    !!!!    

The host .Critical.Thresh.Rpt will look similar but only contain DD's with Critical Warnings.

Script Language:
ksh

Original Author(s): Joe Nielsen, OSW

Note the original author is noted on this page for the purposes of giving credit only. Please address questions/comments to OSW (GS-W OSW Scripts@usgs.gov).

Installation:
This script is part of the OSW Scripts Installation package and should be installed as part of that package. Users needing the script outside of the package should send email to GS-W OSW Scripts@usgs.gov.

NWIS 5.00 OSW Scripts package installation instructions:
http://water.usgs.gov/usgs/osw/adaps/OSW_scripts_pkg.5.00.html

Latest Version Release Notes:

Version 5.00: Included as part of OSW Scripts package for NWIS 5.00+
—updated for NWIS 5.00+ releases (not compatible with NWIS 4.11 or prior)

Back to Scripts
[an error occurred while processing this directive]