Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 10:05:05.251724 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 00:00:00 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt currDate 2020-06-02 00:00:00 f 2 nt-1 5 nt 6 currDate1 2020-06-02 00:00:00 2020-06-02 06:00:00 sdate 2020-06-02 06:00:00 2020-06-02 06:00:00 2 CAT ['TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt currDate 2020-06-02 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-06-02 00:00:00 2020-06-05 00:00:00 sdate 2020-06-05 00:00:00 2020-06-05 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-06-01 18:00:00 20200601.18 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt currDate 2020-06-01 18:00:00 f 1 nt-1 5 nt 6 currDate1 2020-06-01 18:00:00 2020-06-02 00:00:00 sdate 2020-06-02 00:00:00 2020-06-02 00:00:00 1 CAT ['TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060118/all_inpData.txt currDate 2020-06-01 18:00:00 f 1 nt-1 71 nt 72 currDate1 2020-06-01 18:00:00 2020-06-04 18:00:00 sdate 2020-06-04 18:00:00 2020-06-04 18:00:00 12 CAT ['TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/20200602.00_Final_completed_wind.txt FINAL /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/ date: 2020-06-02 00:00:00 first date 20200602.00 alldate: DatetimeIndex(['2020-06-02'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif stormname 1000672/03l stormname 1000672/03l TCbullsource 03l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt 253.949964476 282.03 5.01889875667 31.550035524 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060200/all_inpData.txt currDate 2020-06-02 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-06-02 00:00:00 2020-06-05 00:00:00 sdate 2020-06-05 00:00:00 2020-06-05 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_res_stept0.tif. 0.Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_res_stept0.tif. 0....10..10....20..20....30..30....40..40....50..50....60..60....70..70....80..80....90..90.....100 - done. 100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_stept0_clipped.tif. 0Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050....60.....6070.....70..80....80..90.....90...100 - done. 100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_stept0_clipped.tif. 0...Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_stept0_clipped.tif. 010.....20...10..30....20..40....30..50....40..60....50..70....60.80......7090......80...90...100 - done. 100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml >> 7. remove files done input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_res_all.tif. 0Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_all_clipped.tif. 0Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_all_clipped.tif. 0Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml >> 7. remove files done input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/20200601.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/20200602.00_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/20200602.00_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 10:05:05.251724 UTC Case completed at: 2020-06-02 10:07:59.856370 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 10:15:06.283878 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 10:15:06.283878 UTC Case completed at: 2020-06-02 10:15:06.922133 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 10:25:11.686445 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 2 it: 0 ndt: 2 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 10:25:11.686445 UTC Case completed at: 2020-06-02 10:25:11.791015 UTC **********E N D O F J O B*********************** Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 12:35:05.262898 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 06:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 06:00:00 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt currDate 2020-06-02 06:00:00 f 3 nt-1 5 nt 6 currDate1 2020-06-02 06:00:00 2020-06-02 12:00:00 sdate 2020-06-02 12:00:00 2020-06-02 12:00:00 3 CAT ['TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt currDate 2020-06-02 06:00:00 f 3 nt-1 71 nt 72 currDate1 2020-06-02 06:00:00 2020-06-05 06:00:00 sdate 2020-06-05 06:00:00 2020-06-05 06:00:00 14 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-06-01 18:00:00 20200601.18 meteo-processing past forecast already completed itdate, istime 2020-06-02 00:00:00 20200602.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/20200602.06_Final_completed_wind.txt FINAL /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/ date: 2020-06-02 00:00:00 first date 20200602.00 remove maxtif alldate: DatetimeIndex(['2020-06-02 00:00:00', '2020-06-02 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-06-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif stormname 1000672/03l stormname 1000672/03l TCbullsource 03l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt 253.949964476 282.03 5.01889875667 31.550035524 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060206/all_inpData.txt currDate 2020-06-02 06:00:00 f 3 nt-1 71 nt 72 currDate1 2020-06-02 06:00:00 2020-06-05 06:00:00 sdate 2020-06-05 06:00:00 2020-06-05 06:00:00 14 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/20200601.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/20200602.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/20200602.06_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/20200602.06_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 12:35:05.262898 UTC Case completed at: 2020-06-02 12:37:45.614167 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 12:45:06.302076 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 06:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 12:45:06.302076 UTC Case completed at: 2020-06-02 12:45:06.613626 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 12:55:10.615451 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 06:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 3 it: 0 ndt: 3 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 12:55:10.615451 UTC Case completed at: 2020-06-02 12:55:10.759158 UTC **********E N D O F J O B*********************** Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 18:35:05.563410 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 12:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 12:00:00 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt currDate 2020-06-02 12:00:00 f 4 nt-1 5 nt 6 currDate1 2020-06-02 12:00:00 2020-06-02 18:00:00 sdate 2020-06-02 18:00:00 2020-06-02 18:00:00 4 CAT ['TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt currDate 2020-06-02 12:00:00 f 4 nt-1 71 nt 72 currDate1 2020-06-02 12:00:00 2020-06-05 12:00:00 sdate 2020-06-05 12:00:00 2020-06-05 12:00:00 15 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-06-01 18:00:00 20200601.18 meteo-processing past forecast already completed itdate, istime 2020-06-02 00:00:00 20200602.00 meteo-processing past forecast already completed itdate, istime 2020-06-02 06:00:00 20200602.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/20200602.12_Final_completed_wind.txt FINAL /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/ date: 2020-06-02 00:00:00 first date 20200602.00 remove maxtif alldate: DatetimeIndex(['2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2020-06-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif stormname 1000672/03l stormname 1000672/03l TCbullsource 03l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt 253.949964476 282.03 5.01889875667 31.550035524 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060212/all_inpData.txt currDate 2020-06-02 12:00:00 f 4 nt-1 71 nt 72 currDate1 2020-06-02 12:00:00 2020-06-05 12:00:00 sdate 2020-06-05 12:00:00 2020-06-05 12:00:00 15 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/20200601.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/20200602.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/20200602.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/20200602.12_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/20200602.12_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 18:35:05.563410 UTC Case completed at: 2020-06-02 18:37:37.150182 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 18:45:06.391478 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 12:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 18:45:06.391478 UTC Case completed at: 2020-06-02 18:45:06.568500 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-02 18:55:10.548817 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 12:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 4 it: 0 ndt: 4 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-02 18:55:10.548817 UTC Case completed at: 2020-06-02 18:55:10.756376 UTC **********E N D O F J O B*********************** Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 00:35:07.075503 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 18:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 18:00:00 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt currDate 2020-06-02 18:00:00 f 5 nt-1 5 nt 6 currDate1 2020-06-02 18:00:00 2020-06-03 00:00:00 sdate 2020-06-03 00:00:00 2020-06-03 00:00:00 5 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt currDate 2020-06-02 18:00:00 f 5 nt-1 71 nt 72 currDate1 2020-06-02 18:00:00 2020-06-05 18:00:00 sdate 2020-06-05 18:00:00 2020-06-05 18:00:00 16 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TD', 'TS', 'TD', 'TS', 'TD', 'TS', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-06-01 18:00:00 20200601.18 meteo-processing past forecast already completed itdate, istime 2020-06-02 00:00:00 20200602.00 meteo-processing past forecast already completed itdate, istime 2020-06-02 06:00:00 20200602.06 meteo-processing past forecast already completed itdate, istime 2020-06-02 12:00:00 20200602.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/20200602.18_Final_completed_wind.txt FINAL /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/ date: 2020-06-02 00:00:00 first date 20200602.00 remove maxtif alldate: DatetimeIndex(['2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2020-06-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif stormname 1000672/03l stormname 1000672/03l TCbullsource 03l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt 253.949964476 282.03 5.01889875667 31.550035524 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060218/all_inpData.txt currDate 2020-06-02 18:00:00 f 5 nt-1 71 nt 72 currDate1 2020-06-02 18:00:00 2020-06-05 18:00:00 sdate 2020-06-05 18:00:00 2020-06-05 18:00:00 16 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TD', 'TS', 'TD', 'TS', 'TD', 'TS', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/20200601.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/20200602.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/20200602.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/20200602.12_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/20200602.18_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/20200602.18_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 00:35:07.075503 UTC Case completed at: 2020-06-03 00:37:39.094428 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 00:45:06.597734 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 18:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 00:45:06.597734 UTC Case completed at: 2020-06-03 00:45:06.835757 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 00:55:10.366761 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-02 18:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 5 it: 0 ndt: 5 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-02 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-02 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 00:55:10.366761 UTC Case completed at: 2020-06-03 00:55:10.553200 UTC **********E N D O F J O B*********************** Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 563P x 532L. Processing input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 06:45:06.434292 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-03 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-03 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00', '2020-06-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-03 00:00:00 -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt currDate 2020-06-03 00:00:00 f 6 nt-1 5 nt 6 currDate1 2020-06-03 00:00:00 2020-06-03 06:00:00 sdate 2020-06-03 06:00:00 2020-06-03 06:00:00 6 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.jpg -106.1 -77.97 253.9 282.03 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/ /mnt/input/grib_HWRF/2020/1000672/ input file /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 253.9 5.0 282.03 31.6 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif dd: 0.0499644760213 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt 253.924982238 282.005017762 5.04388099467 31.575017762 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt currDate 2020-06-03 00:00:00 f 6 nt-1 71 nt 72 currDate1 2020-06-03 00:00:00 2020-06-06 00:00:00 sdate 2020-06-06 00:00:00 2020-06-06 00:00:00 17 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-06-01 18:00:00 20200601.18 meteo-processing past forecast already completed itdate, istime 2020-06-02 00:00:00 20200602.00 meteo-processing past forecast already completed itdate, istime 2020-06-02 06:00:00 20200602.06 meteo-processing past forecast already completed itdate, istime 2020-06-02 12:00:00 20200602.12 meteo-processing past forecast already completed itdate, istime 2020-06-02 18:00:00 20200602.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/20200603.00_Final_completed_wind.txt FINAL /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/ date: 2020-06-02 00:00:00 first date 20200602.00 remove maxtif alldate: DatetimeIndex(['2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00', '2020-06-03 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2020-06-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-06-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif stormname 1000672/03l stormname 1000672/03l TCbullsource 03l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt 253.949964476 282.03 5.01889875667 31.550035524 lon 563 lat 532 read TC track /mnt/output/GDACS/TC/TCTrack/1000672/HWRF/2020060300/all_inpData.txt currDate 2020-06-03 00:00:00 f 6 nt-1 71 nt 72 currDate1 2020-06-03 00:00:00 2020-06-06 00:00:00 sdate 2020-06-06 00:00:00 2020-06-06 00:00:00 17 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3376P x 3190L. Processing input file /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3376P x 3190L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200601.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200601.18/20200601.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200601.18/20200601.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.00/20200602.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.00/20200602.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.06/20200602.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.06/20200602.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.12/20200602.12_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.12/20200602.12_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200602.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200602.18/20200602.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200602.18/20200602.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/20200603.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/20200603.00/20200603.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/20200603.00/20200603.00_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/20200603.00_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 253.924982238 4.99168442867 282.058315571 31.575017762 HWRF /usr/bin/gdalwarp -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -106.075017762 4.99168442867 -77.9416844287 31.575017762 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333332 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 06:45:06.434292 UTC Case completed at: 2020-06-03 06:47:37.642207 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 06:55:10.711790 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-03 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-03 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00', '2020-06-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-03 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 06:55:10.711790 UTC Case completed at: 2020-06-03 06:55:10.974001 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-03 07:05:05.885167 UTC inp1= 20200601.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000672/03l submitting calc 2020-06-01 18:00:00 2020-06-03 00:00:00 delft3d -106.1 -77.97 5.0 31.6 4.0 HWRF 72 15 True GDACS/1000672/3_HWRF 6 1 False False 5 aa.txt 20200601.18 1000672/03l 6 wind False *************---------------------****************** GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_6h.tif input file exist GDACS/1000672/3_HWRF 1000672 ndt: 6 it: 0 ndt: 6 idate: 2020-06-01 18:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060118.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2020-06-02 00:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060200.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2020-06-02 06:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060206.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2020-06-02 12:00:00 /mnt/input/grib_HWRF/2020/1000672/three03l.2020060212.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2020-06-02 18:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060218.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2020-06-03 00:00:00 /mnt/input/grib_HWRF/2020/1000672/cristobal03l.2020060300.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000672/3_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-06-01 18:00:00 currdate 2020-06-03 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-06-01 18:00:00', '2020-06-02 00:00:00', '2020-06-02 06:00:00', '2020-06-02 12:00:00', '2020-06-02 18:00:00', '2020-06-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -106.1 -77.97 5.0 31.6 processing curr bull... 2020-06-03 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-03 07:05:05.885167 UTC Case completed at: 2020-06-03 07:05:06.268625 UTC **********E N D O F J O B***********************