Skip to content

horzvert_timeseries.py pair analysis examples #57

@falkamelung

Description

@falkamelung

Here how it works:
https://github.com/geodesymiami/PlotData/blob/main/docs/ARCHITECTURE_horzvert_timeseries.md
Some examples are below. If we find one where it does not work we should fix.

This is not a bug to fix. Lets keep the issue open until we are convinced that it works.

It is helpful to run using --dry-run option and examinthe

horzvert_timeseries.py ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5 ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5 --ref-lalo 0.665 -77.897 --dry-run


HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=84
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=131
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=213
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=2
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A120: 251 images, D142: 387 images
+2 days  213 pairs
-4 days  2 pairs
Total: 215 pair

and examine the image_pairs.txt:

cat image_pairs.txt
     A120      D142
 20141013
*20141025  20141027 (+2)
 20141106
 20141130
*20141212  20141214 (+2)
 20141224
*20150105  20150107 (+2)
 20150117
           20150131
           20150224
 20150306
*20150318  20150320 (+2)
 20150330
*20150411  20150413 (+2)
*20150505  20150507 (+2)
 20150517
           20150531
           20150624
 20150704
           20150718
 20150728
           20150811
 20150821
*20150902  20150904 (+2)
 20150914
*20150926  20150928 (+2)
*20151020  20151022 (+2)
 20151101
*20151113  20151115 (+2)
*20151207  20151209 (+2)
 20151219
 20151231
 20160112
*20160124  20160126 (+2)
*20160217  20160219 (+2)
 20160229
*20160312  20160314 (+2)
 20160324
           20160407
 20160417
*20160429  20160501 (+2)
 20160511
*20160523  20160525 (+2)
 20160604
 20160628
 20160710
*20160803  20160805 (+2)
 20160815
*20160827  20160829 (+2)
+20160926  20160922 (-4)
 20161008
           20161016
           20161022
 20161101
           20161109
           20161115
 20161125
           20161209
 20161219
           20170102
 20170112
           20170126
 20170205
           20170219
 20170301
*20170313  20170315 (+2)
*20170325  20170327 (+2)
           20170408
*20170418  20170420 (+2)
*20170430  20170502 (+2)

First example: Karpathos

horzvert_timeseries.py /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5 
/media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5 --ref-lalo 35.77467 27.18494


HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
open HDFEOS file: geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
open HDFEOS file: geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=328
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=99
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=2

Testing swapped input files:
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenA131/miaplpy_201410_202602/network_delaunay_4/geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
open HDFEOS file: geo_S1_asc_131_miaplpy_20141014_XXXXXXXX_N3562E02713_N3565E02728_N3585E02724_N3583E02707_filtDel4DS.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/KarpathosSenD36/miaplpy_201410_202602/network_delaunay_4/geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
open HDFEOS file: geo_S1_desc_036_miaplpy_20141020_XXXXXXXX_N3583E02728_N3585E02712_N3565E02707_N3562E02724_filtDel4DS.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=328
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=102
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=2
Writing image_pairs.txt .....
Summary:
A131: 472 images, D036: 479 images
0 days  328 pairs
+6 days  102 pairs
-6 days  2 pairs
Total: 432 pairs

It uses A131 as reference although D36 was the first argument:

info.py S1_vert_131_036_miaplpy_20141014_20250805_N3585E02707_N3585E02728_N3562E02728_N3562E02707.he5 | grep ORB
  ORBIT_DIRECTION                             ASCENDING
  ORBIT_DIRECTION_SECOND                      DESCENDING

Second example: Fernandina

horzvert_timeseries.py "/media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5" "/media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5" --ref-lalo -0.453 -91.390

HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=111
shift=+6 pairs found=0
shift=-1 pairs found=83
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenA106/mintpy_good/S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_asc_106_mintpy_20200103_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
HDF5EOS file used: /media/volume/sdb/HDF5EOS/FernandinaSenD128/mintpy_good/S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
open HDFEOS file: S1_desc_128_mintpy_20200104_XXXXXXXX_S0020W09172_S0020W09132_S0057W09132_S0057W09172.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=195
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A106: 200 images, D128: 238 images
+1 days  195 pairs
Total: 195 pairs

Third example: Chiles as above:

horzvert_timeseries.py ChilesSenD142/mintpy_6_24_070/ ChilesSenA120/mintpy_6_24_065 --ref-lalo 0.665 -77.897
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=0
shift=+3 pairs found=0
shift=+4 pairs found=84
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=131
shift=-3 pairs found=0
shift=-4 pairs found=0
shift=-5 pairs found=0
shift=-6 pairs found=0

Testing swapped input files:
HDF5EOS file used: /data/HDF5EOS/ChilesSenA120/mintpy_6_24_065/S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
open HDFEOS file: S1_asc_120_mintpy_20141013_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5
HDF5EOS file used: /data/HDF5EOS/ChilesSenD142/mintpy_6_24_070/S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
open HDFEOS file: S1_desc_142_mintpy_20141027_XXXXXXXX_N0099W07826_N0099W07769_N0050W07769_N0050W07826.he5
Shift schedule blocks: [(0, 6), (-1, -6)]
--------------------------------------------------
Matching dates with custom shift schedule

shift=0 pairs found=0
shift=+1 pairs found=0
shift=+2 pairs found=213
shift=+3 pairs found=0
shift=+4 pairs found=0
shift=+5 pairs found=0
shift=+6 pairs found=0
shift=-1 pairs found=0
shift=-2 pairs found=0
shift=-3 pairs found=0
shift=-4 pairs found=2
shift=-5 pairs found=0
shift=-6 pairs found=0
Writing image_pairs.txt .....
Summary:
A120: 251 images, D142: 387 images
+2 days  213 pairs
-4 days  2 pairs
Total: 215 pairs

It found most pairs for A120 as reference and used it

info.py Chiles/mintpy/S1_horz_120_142_mintpy_20141025_XXXXXXXX_N0099W07826_N0099W07768_N0051W07768_N0051W07826.he5 | grep ORBIT
  ORBIT_DIRECTION                             ASCENDING
  ORBIT_DIRECTION_SECOND                      DESCENDING

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions