Burst DEM passes HyP3 validation but does not fully cover extent in hyp3-OPERA-RTC

[jtherrmann]

Jira: https://asfdaac.atlassian.net/browse/TOOL-3649

Note: The above link is accessible only to members of ASF.

---

This OPERA_RTC job failed with:

Downloaded DEM: /home/rtc_user/scratch/input/dem.tif
Traceback (most recent call last):
Running preprocessor for RtcS1PreProcessorMixin
  File "/home/rtc_user/opera/scripts/pge_main.py", line 190, in <module>
    pge_main()
Starting SAS execution for RtcS1Executor
  File "/home/rtc_user/opera/scripts/pge_main.py", line 186, in pge_main
    pge_start(run_config_filename)
  File "/home/rtc_user/opera/scripts/pge_main.py", line 160, in pge_start
    pge.run()
  File "/home/rtc_user/opera/pge/base/base_pge.py", line 760, in run
    self.run_sas_executable(**kwargs)
  File "/home/rtc_user/opera/pge/base/base_pge.py", line 739, in run_sas_executable
    elapsed_time = time_and_execute(
  File "/home/rtc_user/opera/util/run_utils.py", line 216, in time_and_execute
    logger.critical(module_name, ErrorCode.SAS_PROGRAM_FAILED, error_msg)
  File "/home/rtc_user/opera/util/logger.py", line 407, in critical
    raise RuntimeError(description)
RuntimeError: Command "['/home/rtc_user/miniconda3/condabin/conda', 'run', '--no-capture-output', '-n', 'RTC', 'rtc_s1.py', '/home/rtc_user/scratch/scratch/runconfig_sas.yml']" failed with exit code 1, traceback:
    output imagery nbits: 32
    save secondary layers as HDF5 files: False
    check ancillary coverage: True
Browse images:
    burst height: 2048
    burst width: None
Check ancillary inputs' coverage:
ERROR the DEM file with extents S/N: [53.00013888888889,54.00013888888889] W/E: [-135.00020833333335,-133.00020833333335], does not fully cover product geogrid with extents S/N: [52.99019503270851,53.45689285020637] W/E: [-134.47318046633663,-132.96870959422887]
[StdErr] Traceback (most recent call last):
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/bin/rtc_s1.py", line 41, in <module>
[StdErr]     main()
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/bin/rtc_s1.py", line 36, in main
[StdErr]     run_parallel(cfg, path_logfile_parent, flag_full_log_formatting)
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/rtc_s1.py", line 469, in run_parallel
[StdErr]     check_ancillary_inputs(check_ancillary_inputs_coverage,
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/core.py", line 519, in check_ancillary_inputs
[StdErr]     raise ValueError(msg)
[StdErr] ValueError: ERROR the DEM file with extents S/N: [53.00013888888889,54.00013888888889] W/E: [-135.00020833333335,-133.00020833333335], does not fully cover product geogrid with extents S/N: [52.99019503270851,53.45689285020637] W/E: [-134.47318046633663,-132.96870959422887]

Looking at S1_167854_IW1_20160310T023628_VV_ABE7-BURST in Vertex, it appears to be entirely over water, just off the coast near Alaska/Canada.

I've confirmed that another granule over water, S1_311662_IW3_20160501T164734_VV_6137-BURST, fails to pass HyP3's DEM validator for this job type, so the DEM validator is running as expected. I wonder if this is just a rare edge case, but I figured I'd document it here in case it shows up again.

[jtherrmann]

Another one: https://hyp3-multi-burst-sandbox.asf.alaska.edu/jobs/b8850f80-e881-49ed-a2c9-593771351bc2

Except this granule (S1_105632_IW3_20161103T025614_VV_983F-BURST) is completely over land in Vertex.

ERROR the DEM file with extents S/N: [62.000138888888884,65.00013888888888] W/E: [-144.00027777777777,-137.00027777777777], does not fully cover product geogrid with extents S/N: [64.54346730824017,65.00211410609181] W/E: [-139.98105858641094,-137.99571926682592]
[StdErr] Traceback (most recent call last):
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/bin/rtc_s1.py", line 41, in <module>
[StdErr]     main()
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/bin/rtc_s1.py", line 36, in main
[StdErr]     run_parallel(cfg, path_logfile_parent, flag_full_log_formatting)
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/rtc_s1.py", line 469, in run_parallel
[StdErr]     check_ancillary_inputs(check_ancillary_inputs_coverage,
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/core.py", line 519, in check_ancillary_inputs
[StdErr]     raise ValueError(msg)
[StdErr] ValueError: ERROR the DEM file with extents S/N: [62.000138888888884,65.00013888888888] W/E: [-144.00027777777777,-137.00027777777777], does not fully cover product geogrid with extents S/N: [64.54346730824017,65.00211410609181] W/E: [-139.98105858641094,-137.99571926682592]