Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 03:05:04.753708 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-04 18:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-04 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-04 18:00:00 -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt currDate 2020-10-04 18:00:00 f 1 nt-1 5 nt 6 currDate1 2020-10-04 18:00:00 2020-10-05 00:00:00 sdate 2020-10-05 00:00:00 2020-10-05 00:00:00 1 CAT ['TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.jpg -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt currDate 2020-10-04 18:00:00 f 1 nt-1 71 nt 72 currDate1 2020-10-04 18:00:00 2020-10-07 18:00:00 sdate 2020-10-07 18:00:00 2020-10-07 18:00:00 12 CAT ['TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH', 'MH', 'MH', 'MH'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.jpg processing all past bull only if Past=True... False no past >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/20201004.18_Final_completed_rain.txt FINAL **FIRST alldate: DatetimeIndex(['2020-10-04 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif stormname 1000726/26l stormname 1000726/26l TCbullsource 26l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt 260.47 289.22 9.91999999999 38.57 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100418/all_inpData.txt currDate 2020-10-04 18:00:00 f 1 nt-1 71 nt 72 currDate1 2020-10-04 18:00:00 2020-10-07 18:00:00 sdate 2020-10-07 18:00:00 2020-10-07 18:00:00 12 CAT ['TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH', 'MH', 'MH', 'MH'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/20201004.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/20201004.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 03:05:04.753708 UTC Case completed at: 2020-10-05 03:07:16.643057 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 03:15:06.079611 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-04 18:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-04 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-04 18:00:00 ********** no new data check copy copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 03:15:06.079611 UTC Case completed at: 2020-10-05 03:15:06.164414 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 03:25:09.878391 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-04 18:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 1 it: 0 ndt: 1 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-04 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-04 18:00:00 ********** no new data check copy copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 03:25:09.878391 UTC Case completed at: 2020-10-05 03:25:10.008363 UTC **********E N D O F J O B*********************** Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 06:45:05.159429 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 00:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 00:00:00 -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt currDate 2020-10-05 00:00:00 f 2 nt-1 5 nt 6 currDate1 2020-10-05 00:00:00 2020-10-05 06:00:00 sdate 2020-10-05 06:00:00 2020-10-05 06:00:00 2 CAT ['TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.jpg -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt currDate 2020-10-05 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-10-05 00:00:00 2020-10-08 00:00:00 sdate 2020-10-08 00:00:00 2020-10-08 00:00:00 13 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'H', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-10-04 18:00:00 20201004.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/20201005.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/ date: 2020-10-05 00:00:00 first date 20201005.00 remove maxtif alldate: DatetimeIndex(['2020-10-05'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif stormname 1000726/26l stormname 1000726/26l TCbullsource 26l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt 260.47 289.22 9.91999999999 38.57 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100500/all_inpData.txt currDate 2020-10-05 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-10-05 00:00:00 2020-10-08 00:00:00 sdate 2020-10-08 00:00:00 2020-10-08 00:00:00 13 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'H', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/20201004.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/20201005.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/20201005.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 06:45:05.159429 UTC Case completed at: 2020-10-05 06:47:13.714358 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 06:55:09.126077 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 00:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 06:55:09.126077 UTC Case completed at: 2020-10-05 06:55:09.217816 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 07:05:06.134673 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 00:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 07:05:06.134673 UTC Case completed at: 2020-10-05 07:05:06.195936 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 07:15:05.507253 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 00:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 2 it: 0 ndt: 2 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 07:15:05.507253 UTC Case completed at: 2020-10-05 07:15:05.585921 UTC **********E N D O F J O B*********************** Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 576P x 574L. Processing input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 14:35:05.849353 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 06:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00', '2020-10-05 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 06:00:00 -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt currDate 2020-10-05 06:00:00 f 3 nt-1 5 nt 6 currDate1 2020-10-05 06:00:00 2020-10-05 12:00:00 sdate 2020-10-05 12:00:00 2020-10-05 12:00:00 3 CAT ['TS', 'TS', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.jpg -99.58 -70.78 260.42 289.22 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/ /mnt/input/grib_HWRF/2020/1000726/ input file /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 260.42 9.9 289.22 38.62 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt 260.445 289.195 9.945 38.595 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt currDate 2020-10-05 06:00:00 f 3 nt-1 71 nt 72 currDate1 2020-10-05 06:00:00 2020-10-08 06:00:00 sdate 2020-10-08 06:00:00 2020-10-08 06:00:00 14 CAT ['TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-10-04 18:00:00 20201004.18 meteo-processing past forecast already completed itdate, istime 2020-10-05 00:00:00 20201005.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/20201005.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/ date: 2020-10-05 00:00:00 first date 20201005.00 remove maxtif alldate: DatetimeIndex(['2020-10-05 00:00:00', '2020-10-05 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-10-05 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif stormname 1000726/26l stormname 1000726/26l TCbullsource 26l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt 260.47 289.22 9.91999999999 38.57 lon 576 lat 574 read TC track /mnt/output/GDACS/TC/TCTrack/1000726/HWRF/2020100506/all_inpData.txt currDate 2020-10-05 06:00:00 f 3 nt-1 71 nt 72 currDate1 2020-10-05 06:00:00 2020-10-08 06:00:00 sdate 2020-10-08 06:00:00 2020-10-08 06:00:00 14 CAT ['TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3456P x 3444L. Processing input file /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3456P x 3444L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201004.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201004.18/20201004.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201004.18/20201004.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.00/20201005.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.00/20201005.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/20201005.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/20201005.06/20201005.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/20201005.06/20201005.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/20201005.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 260.445 9.89500000001 289.245 38.595 HWRF /usr/bin/gdalwarp -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -99.555 9.89500000001 -70.755 38.595 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 14:35:05.849353 UTC Case completed at: 2020-10-05 14:37:13.345518 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 14:45:05.596742 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 06:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00', '2020-10-05 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 14:45:05.596742 UTC Case completed at: 2020-10-05 14:45:05.707434 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-10-05 14:55:12.444440 UTC inp1= 20201004.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000726/26l submitting calc 2020-10-04 18:00:00 2020-10-05 06:00:00 delft3d -99.58 -70.78 9.9 38.62 4.0 HWRF 72 15 True GDACS/1000726/2_HWRF 6 1 False False 2 aa.txt 20201004.18 1000726/26l 6 rain False *************---------------------****************** GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_6h.tif input file exist GDACS/1000726/2_HWRF 1000726 ndt: 3 it: 0 ndt: 3 idate: 2020-10-04 18:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100418.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2020-10-05 00:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100500.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2020-10-05 06:00:00 /mnt/input/grib_HWRF/2020/1000726/twenty-si26l.2020100506.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000726/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-10-04 18:00:00 currdate 2020-10-05 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-10-04 18:00:00', '2020-10-05 00:00:00', '2020-10-05 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -99.58 -70.78 9.9 38.62 processing curr bull... 2020-10-05 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-10-05 14:55:12.444440 UTC Case completed at: 2020-10-05 14:55:12.630466 UTC **********E N D O F J O B***********************