USGS Home Contact USGS Search USGS

RT.Editor

Name:
RT.Editor - A utility combining the ADAPS programs data_qa_summary and Hydra into a unit-value screening and editing tool.

This script was retired from active support in July 2008. This page is available for historical reference and to allow access to the code in case someone wants to try his or her hand in updating it. Use of the script without extensive testing is not recommended and the consequences are your own. If you feel this script was retired prematurely and would like to see it restored send email to GS-W OSW Scripts@usgs.gov.

Information:

A brief summary of what the script does is this:

1. Runs the data_qa_summary program on a selected group and date range. This new 4.2 program summarizes the number of threshold flags that exist on the UVs for a site.
2. Compiles and prints a summary list of the sites where it found threshold flags set. For a more complete picture of possible problem sites, the script also includes in the summary list those sites where it found no unit values at all, but it does not use those sites in the rest of the program.
3. Runs Hydra for each site included in the summary list and allows the user to edit the UV data as needed. When the user quits one site the script automatically loads the next site. If the user SAVES from Hydra a primary is automatically run to pass any edits through the system.

The idea is for a user to use the threshold settings (very high, high, rapid increase, etc., etc.) to find potentially bad data, then automatically bring just those sites up in Hydra where they can be edited or flagged erroneous as needed, and then push just those sites to NWISWeb. With good use of the threshold settings, it is hoped is that this takes an inefficient five step process of looking at UV data every day and makes it a much more efficient one step process.

Script Language:
sh

Requirements:

• an ADAPS group of the sites you want to screen
• threshold settings for the input DDs on those sites

Original Author(s): Joe Nielsen, OSW and Ed Fischer, Iowa District

Note the original author is noted on this page for the purposes of giving credit only. Please address questions/comments to OSW (GS-W OSW Scripts@usgs.gov).

Known Problems/Limitations/Need Improvements:
The program is a demonstration of something that will hopefully be added directly to ADAPS in the not to distant future. When it does, there are several things that can be improved, including (but not limited to):

1. Improved performance
2. More sophisticated error checking (Lamar Sanders in SC has a lot of good ideas regarding this)
3. Auto flagging of unit values as erroneous (allow a user to optionally set some thresholds to automatically flag data as bad). Note that in NWIS 4.5 auto flagging now exists for critical thresholds (very high, very low, very rapid increase/decrease) which partially eliminates the need for this script. It is still useful, however, for screening the other thresholds.

There are also some things that could be added to the script itself in the meantime:

1. Use of the "missing data" and "same data" fields in the data_qa_summary program. These might not be useful for the Hydra part of the script. but it might be nice to scan these for potential problem sites to include in the printout.
2. Breaking the program into two parts. The first part being one that produces the report and that could be run automatically every day. The second part being the Hydra portion that could be run by any user any time.

We will add these and any other good idea as they come in depending on interst and time availablity.

Scripts:

Version 1.4 (posted 8/16/2006)
- added option to run on edited UVs now that this option is available in data_qa_summary

RT.Editor 1.4 download (Zip file = 6.0K)
containing files:

rt.editor.readme

rt.editor