CSPP SDR install and run instructions for DBNet operators
Liam.Gumley@ssec.wisc.edu
Oct 14, 2020

CSPP SDR version: 3.2               # ATMS and CrIS SDR processing
AAPP version: 8.6                   # ATMS and CrIS BUFR conversion

1. OVERVIEW

This guide and the associated scripts and files show how to install and run CSPP SDR in a way
that is recommended for DBNet operators.

2. REQUIREMENTS

To run CSPP SDR
- Intel or AMD host computer running 64-bit CentOS v6.10 or v7.8
To run AAPP
- Singularity v3.5 or higher

3. INSTALL 

The install process involves downloading software and data tarfiles, unpacking the tarfiles, and updating
the lookup table and ancillary database. The steps are shown below.

cd $HOME
mkdir CSPP_DBNET
cd CSPP_DBNET 
curl -O https://bin.ssec.wisc.edu/pub/gumley/dbnet/cspp/cspp_sdr_3.2_install.tar.gz
tar -xvf cspp_sdr_3.2_install.tar.gz
./download_8.6.sh                   # Download the CSPP SDR tarfiles and verify checksums (requires 17 GB of free space)
./install_8.6.sh                    # Install CSPP SDR and update the LUT and ancillary database (requires 70 GB of free space)

4. RUN

To run CSPP SDR for ATMS and CrIS processing, set the environment as shown below

export CSPP_SDR_HOME=$HOME/CSPP_DBNET/SDR_3_2
source $CSPP_SDR_HOME/cspp_sdr_env.sh
export PATH=$HOME/CSPP_DBNET/scripts:$PATH

To convert ATMS and CrIS file to BUFR, you must have the AAPP v8.6 software installed as described in
"AAPP, OPS-LRS, and Metopizer build and run instructions for DBNet operators". Set the environment for AAPP
as shown below

export AAPP_INSTALL_DIR=$HOME/AAPP_DBNET/aapp_8.6
export PATH=$AAPP_INSTALL_DIR/scripts:$PATH
source $AAPP_INSTALL_DIR/scripts/aapp_station_config.bash

The following commands are used to process SNPP and NOAA-20 ATMS and CrIS direct broadcast data and create DBNet-compliant BUFR files.

cspp_atms_sdr.bash                   # Process a SNPP or NOAA-20 ATMS RDR file to create SDR output files
cspp_cris_sdr.bash                   # Process a SNPP or NOAA-20 CrIS RDR file to create SDR output files (full spectral resolution)

sdr_ancillary.sh                     # Update ancillary data needed by CSPP SDR (this should be run daily)
sdr_luts.sh                          # Update lookup tables needed by CSPP SDR (this should be run weekly)

aapp_station_config.bash             # Station-specific settings for DBNet BUFR files (edit for your station; this script must be 'source'd)
aapp_atms_bufr.bash                  # Create DBNet BUFR files from ATMS SDR files in current directory
aapp_cris_bufr.bash                  # Create DBNet BUFR files from CrIS SDR files in current directory

5. TEST

Test data for SNPP and NOAA-20 can be downloaded as shown below and used to test the installed software packages.
NOTE: The test case assumes that the software environment has been configured as shown in step 4.

cd $HOME
cd CSPP_DBNET
curl -O https://bin.ssec.wisc.edu/pub/gumley/dbnet/cspp/cspp_sdr_3.2_test.tar.gz
tar -xvf cspp_sdr_3.2_test.tar.gz
cd test
./cspp_test.bash

The list of DBNet BUFR files that should be created is shown below:

find . -name \*.bin | sort
./atms/noaa20/W_us-noaa-ssec,atms,DBNet+noaa20+mad_C_KWBC_20201014215706_atms_noaa20_20201013_1834_15046_bufr.bin
./atms/snpp/W_us-noaa-ssec,atms,DBNet+snpp+mad_C_KWBC_20201014215640_atms_snpp_20201014_0742_46449_bufr.bin
./cris/noaa20/W_us-noaa-ssec,cris,DBNet+noaa20+mad_C_KWBC_20201014220707_cris_noaa20_20201011_0930_15011_bufr.bin
./cris/snpp/W_us-noaa-ssec,cris,DBNet+snpp+mad_C_KWBC_20201014220203_cris_snpp_20201014_0925_46450_bufr.bin