******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-20 21:05:05.421099 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-20 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 1 it: 0 ndt: 1 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 1 it: 0 ndt: 1 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-20 12:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-20 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/ /mnt/input/grib_HWRF/2020/1000701/ Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-20 21:15:06.067140 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-20 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 1 it: 0 ndt: 1 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 1 it: 0 ndt: 1 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-20 12:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-20 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt currDate 2020-08-20 12:00:00 f 1 nt-1 5 nt 6 currDate1 2020-08-20 12:00:00 2020-08-20 18:00:00 sdate 2020-08-20 18:00:00 2020-08-20 18:00:00 1 CAT ['TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt currDate 2020-08-20 12:00:00 f 1 nt-1 71 nt 72 currDate1 2020-08-20 12:00:00 2020-08-23 12:00:00 sdate 2020-08-23 12:00:00 2020-08-23 12:00:00 12 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg processing all past bull only if Past=True... False no past >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200820.12_Final_completed_rain.txt FINAL **FIRST alldate: DatetimeIndex(['2020-08-20 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082012/all_inpData.txt currDate 2020-08-20 12:00:00 f 1 nt-1 71 nt 72 currDate1 2020-08-20 12:00:00 2020-08-23 12:00:00 sdate 2020-08-23 12:00:00 2020-08-23 12:00:00 12 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200820.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-20 21:15:06.067140 UTC Case completed at: 2020-08-20 21:16:34.072550 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 00:35:05.561196 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-20 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 2 it: 0 ndt: 2 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-08-20 18:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000701/.2020082018.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/.2020082018.swath.rain_6h.tif home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret -4 no impact estimation ============================================================== Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 00:45:05.979180 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-20 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 2 it: 0 ndt: 2 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 2 it: 0 ndt: 2 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-20 18:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-20 18:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt currDate 2020-08-20 18:00:00 f 2 nt-1 5 nt 6 currDate1 2020-08-20 18:00:00 2020-08-21 00:00:00 sdate 2020-08-21 00:00:00 2020-08-21 00:00:00 2 CAT ['TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt currDate 2020-08-20 18:00:00 f 2 nt-1 71 nt 72 currDate1 2020-08-20 18:00:00 2020-08-23 18:00:00 sdate 2020-08-23 18:00:00 2020-08-23 18:00:00 13 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200820.18_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082018/all_inpData.txt currDate 2020-08-20 18:00:00 f 2 nt-1 71 nt 72 currDate1 2020-08-20 18:00:00 2020-08-23 18:00:00 sdate 2020-08-23 18:00:00 2020-08-23 18:00:00 13 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200820.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 00:45:05.979180 UTC Case completed at: 2020-08-21 00:46:46.274464 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 00:55:09.309428 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-20 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 2 it: 0 ndt: 2 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 2 it: 0 ndt: 2 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-20 18:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-20 18:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 00:55:09.309428 UTC Case completed at: 2020-08-21 00:55:09.405775 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 06:35:05.553300 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 3 it: 0 ndt: 3 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-08-21 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000701/.2020082100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/.2020082100.swath.rain_6h.tif home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 06:45:05.540166 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 3 it: 0 ndt: 3 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 3 it: 0 ndt: 3 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 00:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 00:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/ /mnt/input/grib_HWRF/2020/1000701/ Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 06:55:09.680122 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 3 it: 0 ndt: 3 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 3 it: 0 ndt: 3 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 00:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 00:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt currDate 2020-08-21 00:00:00 f 3 nt-1 5 nt 6 currDate1 2020-08-21 00:00:00 2020-08-21 06:00:00 sdate 2020-08-21 06:00:00 2020-08-21 06:00:00 3 CAT ['TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt currDate 2020-08-21 00:00:00 f 3 nt-1 71 nt 72 currDate1 2020-08-21 00:00:00 2020-08-24 00:00:00 sdate 2020-08-24 00:00:00 2020-08-24 00:00:00 14 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'H', 'TS', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200821.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082100/all_inpData.txt currDate 2020-08-21 00:00:00 f 3 nt-1 71 nt 72 currDate1 2020-08-21 00:00:00 2020-08-24 00:00:00 sdate 2020-08-24 00:00:00 2020-08-24 00:00:00 14 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'H', 'TS', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200821.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 06:55:09.680122 UTC Case completed at: 2020-08-21 07:00:48.241807 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 13:55:09.748150 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 06:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 4 it: 0 ndt: 4 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 4 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 4 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 4 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 4 it: 0 ndt: 4 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 4 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 4 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 4 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 06:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 06:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt currDate 2020-08-21 06:00:00 f 4 nt-1 5 nt 6 currDate1 2020-08-21 06:00:00 2020-08-21 12:00:00 sdate 2020-08-21 12:00:00 2020-08-21 12:00:00 4 CAT ['TD', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt currDate 2020-08-21 06:00:00 f 4 nt-1 71 nt 72 currDate1 2020-08-21 06:00:00 2020-08-24 06:00:00 sdate 2020-08-24 06:00:00 2020-08-24 06:00:00 15 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200821.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082106/all_inpData.txt currDate 2020-08-21 06:00:00 f 4 nt-1 71 nt 72 currDate1 2020-08-21 06:00:00 2020-08-24 06:00:00 sdate 2020-08-24 06:00:00 2020-08-24 06:00:00 15 CAT ['TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200821.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 13:55:09.748150 UTC Case completed at: 2020-08-21 13:56:36.800567 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 14:05:06.146194 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 06:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 4 it: 0 ndt: 4 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 4 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 4 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 4 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 4 it: 0 ndt: 4 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 4 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 4 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 4 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 06:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 06:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 14:05:06.146194 UTC Case completed at: 2020-08-21 14:05:06.312602 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 23:45:17.916618 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 5 it: 0 ndt: 5 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 5 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 5 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 5 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 5 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 5 it: 0 ndt: 5 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 5 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 5 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 5 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 5 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 12:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt currDate 2020-08-21 12:00:00 f 5 nt-1 5 nt 6 currDate1 2020-08-21 12:00:00 2020-08-21 18:00:00 sdate 2020-08-21 18:00:00 2020-08-21 18:00:00 5 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt currDate 2020-08-21 12:00:00 f 5 nt-1 71 nt 72 currDate1 2020-08-21 12:00:00 2020-08-24 12:00:00 sdate 2020-08-24 12:00:00 2020-08-24 12:00:00 16 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200821.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082112/all_inpData.txt currDate 2020-08-21 12:00:00 f 5 nt-1 71 nt 72 currDate1 2020-08-21 12:00:00 2020-08-24 12:00:00 sdate 2020-08-24 12:00:00 2020-08-24 12:00:00 16 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200821.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 23:45:17.916618 UTC Case completed at: 2020-08-21 23:46:42.568805 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-21 23:55:09.744332 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-21 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 5 it: 0 ndt: 5 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 5 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 5 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 5 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 5 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 5 it: 0 ndt: 5 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 5 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 5 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 5 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 5 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-21 12:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-21 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-21 23:55:09.744332 UTC Case completed at: 2020-08-21 23:55:10.035248 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-22 21:55:10.540794 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-22 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-22 12:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-22 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt currDate 2020-08-22 12:00:00 f 9 nt-1 5 nt 6 currDate1 2020-08-22 12:00:00 2020-08-22 18:00:00 sdate 2020-08-22 18:00:00 2020-08-22 18:00:00 9 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt currDate 2020-08-22 12:00:00 f 9 nt-1 71 nt 72 currDate1 2020-08-22 12:00:00 2020-08-25 12:00:00 sdate 2020-08-25 12:00:00 2020-08-25 12:00:00 20 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt currDate 2020-08-21 18:00:00 f 6 nt-1 5 nt 6 currDate1 2020-08-21 18:00:00 2020-08-22 00:00:00 sdate 2020-08-22 00:00:00 2020-08-22 00:00:00 6 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082118/all_inpData.txt currDate 2020-08-21 18:00:00 f 6 nt-1 71 nt 72 currDate1 2020-08-21 18:00:00 2020-08-24 18:00:00 sdate 2020-08-24 18:00:00 2020-08-24 18:00:00 17 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg itdate, istime 2020-08-22 00:00:00 20200822.00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt currDate 2020-08-22 00:00:00 f 7 nt-1 5 nt 6 currDate1 2020-08-22 00:00:00 2020-08-22 06:00:00 sdate 2020-08-22 06:00:00 2020-08-22 06:00:00 7 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082200/all_inpData.txt currDate 2020-08-22 00:00:00 f 7 nt-1 71 nt 72 currDate1 2020-08-22 00:00:00 2020-08-25 00:00:00 sdate 2020-08-25 00:00:00 2020-08-25 00:00:00 18 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TD', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg itdate, istime 2020-08-22 06:00:00 20200822.06 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt currDate 2020-08-22 06:00:00 f 8 nt-1 5 nt 6 currDate1 2020-08-22 06:00:00 2020-08-22 12:00:00 sdate 2020-08-22 12:00:00 2020-08-22 12:00:00 8 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082206/all_inpData.txt currDate 2020-08-22 06:00:00 f 8 nt-1 71 nt 72 currDate1 2020-08-22 06:00:00 2020-08-25 06:00:00 sdate 2020-08-25 06:00:00 2020-08-25 06:00:00 19 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200822.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 8 date: 2020-08-21 00:00:00 pytho0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done n /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082212/all_inpData.txt currDate 2020-08-22 12:00:00 f 9 nt-1 71 nt 72 currDate1 2020-08-22 12:00:00 2020-08-25 12:00:00 sdate 2020-08-25 12:00:00 2020-08-25 12:00:00 20 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_res_stept0.tif. 0.Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_res_stept0.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_res_stept0.tif. 0......10...1010......20...2020......30...3030......40...4040......50...5050......60...6060......70...7070......80...8080......90...9090........100 - done. 100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_stept0_clipped.tif. 0......1010..Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_stept0_clipped.tif. 0.....2020........103030.........204040.........305050.........406060........50..7070......60...8080......70...9090......80.....90...100 - done. 100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_stept0_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml >> 7. remove files done lim core Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_res_all.tif. 0.Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_res_all.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_res_all.tif. 0.....10..10......2010.......2030..20.....40...30.30...50.....40...60.40.....70.50.....8050........906060.......70.70......80..80.....9090......100 - done. 100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_all_clipped.tif. 0.....Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_all_clipped.tif. 010...10......20.10.20......30...2030......40...3040......50...4050.......60.50.60.......70.60.70.......8070...80......9080...90.......90...100 - done. 100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_all_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml >> 7. remove files done lim core Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200822.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-22 21:55:10.540794 UTC Case completed at: 2020-08-22 21:58:50.406518 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-22 22:05:06.416428 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-22 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-22 12:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-22 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-22 22:05:06.416428 UTC Case completed at: 2020-08-22 22:05:07.026731 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-22 22:15:06.208177 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-22 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 9 it: 0 ndt: 9 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 9 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-22 12:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-22 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-22 22:15:06.208177 UTC Case completed at: 2020-08-22 22:15:06.669663 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 09:55:09.087068 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 00:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 00:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt currDate 2020-08-23 00:00:00 f 11 nt-1 5 nt 6 currDate1 2020-08-23 00:00:00 2020-08-23 06:00:00 sdate 2020-08-23 06:00:00 2020-08-23 06:00:00 11 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt currDate 2020-08-23 00:00:00 f 11 nt-1 71 nt 72 currDate1 2020-08-23 00:00:00 2020-08-26 00:00:00 sdate 2020-08-26 00:00:00 2020-08-26 00:00:00 22 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt currDate 2020-08-22 18:00:00 f 10 nt-1 5 nt 6 currDate1 2020-08-22 18:00:00 2020-08-23 00:00:00 sdate 2020-08-23 00:00:00 2020-08-23 00:00:00 10 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082218/all_inpData.txt currDate 2020-08-22 18:00:00 f 10 nt-1 71 nt 72 currDate1 2020-08-22 18:00:00 2020-08-25 18:00:00 sdate 2020-08-25 18:00:00 2020-08-25 18:00:00 21 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200823.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 10 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082300/all_inpData.txt currDate 2020-08-23 00:00:00 f 11 nt-1 71 nt 72 currDate1 2020-08-23 00:00:00 2020-08-26 00:00:00 sdate 2020-08-26 00:00:00 2020-08-26 00:00:00 22 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_res_stept0.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_res_stept0.tif. 0......10.10....20..20...30....30..40.....4050......6050......70.60....80..70....90..80.....90...100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_res_all.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_all_clipped.tif. 0...10..Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_all_clipped.tif. 0.20......30.10...40.....2050......6030......70.40....80..50....90..60.....70...80...90...100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200823.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 09:55:09.087068 UTC Case completed at: 2020-08-23 09:57:01.204573 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 10:05:07.774690 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 00:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 10:05:07.774690 UTC Case completed at: 2020-08-23 10:05:08.551224 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 10:15:05.188211 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 11 it: 0 ndt: 11 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 11 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 00:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 10:15:05.188211 UTC Case completed at: 2020-08-23 10:15:05.652724 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 22:15:12.792840 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 12:00:00 ndt: 72 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt currDate 2020-08-23 12:00:00 f 13 nt-1 5 nt 6 currDate1 2020-08-23 12:00:00 2020-08-23 18:00:00 sdate 2020-08-23 18:00:00 2020-08-23 18:00:00 13 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt currDate 2020-08-23 12:00:00 f 13 nt-1 71 nt 72 currDate1 2020-08-23 12:00:00 2020-08-26 12:00:00 sdate 2020-08-26 12:00:00 2020-08-26 12:00:00 24 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt currDate 2020-08-23 06:00:00 f 12 nt-1 5 nt 6 currDate1 2020-08-23 06:00:00 2020-08-23 12:00:00 sdate 2020-08-23 12:00:00 2020-08-23 12:00:00 12 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082306/all_inpData.txt currDate 2020-08-23 06:00:00 f 12 nt-1 71 nt 72 currDate1 2020-08-23 06:00:00 2020-08-26 06:00:00 sdate 2020-08-26 06:00:00 2020-08-26 06:00:00 23 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200823.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 12 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082312/all_inpData.txt currDate 2020-08-23 12:00:00 f 13 nt-1 71 nt 72 currDate1 2020-08-23 12:00:00 2020-08-26 12:00:00 sdate 2020-08-26 12:00:00 2020-08-26 12:00:00 24 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_res_stept0.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_res_stept0.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_stept0_clipped.tif. 0......1010......2020.....30..30....40..40....50..50....60..60....70..70....80..80....90..90.....100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_res_all.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_all_clipped.tif. 0...Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_all_clipped.tif. 010......2010.....30..20....40...30..50....40..60....50..70....60..80....70..90....80....90...100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200823.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 22:15:12.792840 UTC Case completed at: 2020-08-23 22:17:09.350376 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 22:25:10.771510 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 12:00:00 ndt: 72 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 22:25:10.771510 UTC Case completed at: 2020-08-23 22:25:11.699406 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-23 22:35:06.553468 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 13 it: 0 ndt: 13 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 13 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 13 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 13 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 13 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 13 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 13 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 13 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 13 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 13 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 13 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 13 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 13 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 12:00:00 ndt: 72 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-23 22:35:06.553468 UTC Case completed at: 2020-08-23 22:35:07.222594 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 06:25:10.435109 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 18:00:00 ndt: 78 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 18:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt currDate 2020-08-23 18:00:00 f 14 nt-1 5 nt 6 currDate1 2020-08-23 18:00:00 2020-08-24 00:00:00 sdate 2020-08-24 00:00:00 2020-08-24 00:00:00 14 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt currDate 2020-08-23 18:00:00 f 14 nt-1 71 nt 72 currDate1 2020-08-23 18:00:00 2020-08-26 18:00:00 sdate 2020-08-26 18:00:00 2020-08-26 18:00:00 25 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'MH'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200823.18_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 13 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082318/all_inpData.txt currDate 2020-08-23 18:00:00 f 14 nt-1 71 nt 72 currDate1 2020-08-23 18:00:00 2020-08-26 18:00:00 sdate 2020-08-26 18:00:00 2020-08-26 18:00:00 25 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'MH'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200823.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 06:25:10.435109 UTC Case completed at: 2020-08-24 06:26:44.446740 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 06:35:06.468130 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 18:00:00 ndt: 78 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 06:35:06.468130 UTC Case completed at: 2020-08-24 06:35:07.602431 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 06:45:06.026572 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-23 18:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 14 it: 0 ndt: 14 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 14 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 14 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 14 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 14 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 14 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 14 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 14 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 14 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 14 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 14 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 14 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 14 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 14 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-23 18:00:00 ndt: 78 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-23 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 06:45:06.026572 UTC Case completed at: 2020-08-24 06:45:07.298204 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 07:15:05.487464 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 15 it: 0 ndt: 15 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 15 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 15 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 15 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 15 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 15 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 15 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 15 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 15 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 15 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 15 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 15 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 15 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 15 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 15 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 15 it: 0 ndt: 15 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 15 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 15 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 15 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 15 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 15 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 15 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 15 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 15 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 15 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 15 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 15 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 15 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 15 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 15 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 00:00:00 ndt: 84 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 00:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt currDate 2020-08-24 00:00:00 f 15 nt-1 5 nt 6 currDate1 2020-08-24 00:00:00 2020-08-24 06:00:00 sdate 2020-08-24 06:00:00 2020-08-24 06:00:00 15 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt currDate 2020-08-24 00:00:00 f 15 nt-1 71 nt 72 currDate1 2020-08-24 00:00:00 2020-08-27 00:00:00 sdate 2020-08-27 00:00:00 2020-08-27 00:00:00 26 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed itdate, istime 2020-08-23 18:00:00 20200823.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200824.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 14 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082400/all_inpData.txt currDate 2020-08-24 00:00:00 f 15 nt-1 71 nt 72 currDate1 2020-08-24 00:00:00 2020-08-27 00:00:00 sdate 2020-08-27 00:00:00 2020-08-27 00:00:00 26 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/20200824.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200824.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 07:15:05.487464 UTC Case completed at: 2020-08-24 07:16:31.191281 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 07:25:10.452654 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 15 it: 0 ndt: 15 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 15 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 15 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 15 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 15 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 15 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 15 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 15 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 15 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 15 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 15 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 15 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 15 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 15 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 15 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 15 it: 0 ndt: 15 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 15 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 15 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 15 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 15 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 15 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 15 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 15 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 15 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 15 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 15 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 15 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 15 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 15 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 15 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 00:00:00 ndt: 84 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 07:25:10.452654 UTC Case completed at: 2020-08-24 07:25:17.386075 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_48h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_48h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 14:05:05.427128 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 06:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 16 it: 0 ndt: 16 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 16 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 16 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 16 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 16 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 16 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 16 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 16 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 16 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 16 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 16 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 16 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 16 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 16 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 16 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 16 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 16 it: 0 ndt: 16 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 16 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 16 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 16 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 16 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 16 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 16 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 16 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 16 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 16 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 16 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 16 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 16 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 16 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 16 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 16 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 06:00:00 ndt: 90 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 06:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt currDate 2020-08-24 06:00:00 f 16 nt-1 5 nt 6 currDate1 2020-08-24 06:00:00 2020-08-24 12:00:00 sdate 2020-08-24 12:00:00 2020-08-24 12:00:00 16 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_48h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt currDate 2020-08-24 06:00:00 f 16 nt-1 71 nt 72 currDate1 2020-08-24 06:00:00 2020-08-27 06:00:00 sdate 2020-08-27 06:00:00 -2 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed itdate, istime 2020-08-23 18:00:00 20200823.18 meteo-processing past forecast already completed itdate, istime 2020-08-24 00:00:00 20200824.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200824.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 15 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082406/all_inpData.txt currDate 2020-08-24 06:00:00 f 16 nt-1 71 nt 72 currDate1 2020-08-24 06:00:00 2020-08-27 06:00:00 sdate 2020-08-27 06:00:00 -2 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/20200824.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/20200824.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200824.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 14:05:05.427128 UTC Case completed at: 2020-08-24 14:06:40.510484 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 21:55:10.987572 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 12:00:00 ndt: 96 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt currDate 2020-08-24 12:00:00 f 17 nt-1 5 nt 6 currDate1 2020-08-24 12:00:00 2020-08-24 18:00:00 sdate 2020-08-24 18:00:00 2020-08-24 18:00:00 17 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt currDate 2020-08-24 12:00:00 f 17 nt-1 71 nt 72 currDate1 2020-08-24 12:00:00 2020-08-27 12:00:00 sdate 2020-08-27 12:00:00 2020-08-27 12:00:00 28 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed itdate, istime 2020-08-23 18:00:00 20200823.18 meteo-processing past forecast already completed itdate, istime 2020-08-24 00:00:00 20200824.00 meteo-processing past forecast already completed itdate, istime 2020-08-24 06:00:00 20200824.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200824.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 16 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/10007010 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done /2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt currDate 2020-08-24 12:00:00 f 17 nt-1 71 nt 72 currDate1 2020-08-24 12:00:00 2020-08-27 12:00:00 sdate 2020-08-27 12:00:00 2020-08-27 12:00:00 28 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_stept0.xml t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/20200824.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/20200824.06_copy_completed_rain.txt check t0 xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/20200824.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200824.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 21:55:10.987572 UTC Case completed at: 2020-08-24 21:56:31.898394 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 22:05:06.504628 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 12:00:00 ndt: 96 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 12:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt currDate 2020-08-24 12:00:00 f 17 nt-1 5 nt 6 currDate1 2020-08-24 12:00:00 2020-08-24 18:00:00 sdate 2020-08-24 18:00:00 2020-08-24 18:00:00 17 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082412/all_inpData.txt currDate 2020-08-24 12:00:00 f 17 nt-1 71 nt 72 currDate1 2020-08-24 12:00:00 2020-08-27 12:00:00 sdate 2020-08-27 12:00:00 2020-08-27 12:00:00 28 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed itdate, istime 2020-08-23 18:00:00 20200823.18 meteo-processing past forecast already completed itdate, istime 2020-08-24 00:00:00 20200824.00 meteo-processing past forecast already completed itdate, istime 2020-08-24 06:00:00 20200824.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200824.12_Final_completed_rain.txt ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/20200824.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/20200824.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/20200824.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200824.12_final_completed_rain.txt copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 22:05:06.504628 UTC Case completed at: 2020-08-24 22:05:46.981623 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-24 22:15:07.180450 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-24 12:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 17 it: 0 ndt: 17 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 17 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 17 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 17 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 17 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 17 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 17 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 17 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 17 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 17 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 17 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 17 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 17 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 17 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 17 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 17 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 17 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-24 12:00:00 ndt: 96 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-24 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-24 22:15:07.180450 UTC Case completed at: 2020-08-24 22:15:09.002163 UTC **********E N D O F J O B*********************** Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 460P x 400L. Processing input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-25 10:15:05.700165 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-25 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-25 00:00:00 ndt: 108 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00', '2020-08-24 18:00:00', '2020-08-25 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-25 00:00:00 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt currDate 2020-08-25 00:00:00 f 19 nt-1 5 nt 6 currDate1 2020-08-25 00:00:00 2020-08-25 06:00:00 sdate 2020-08-25 06:00:00 2020-08-25 06:00:00 19 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt currDate 2020-08-25 00:00:00 f 19 nt-1 71 nt 72 currDate1 2020-08-25 00:00:00 2020-08-28 00:00:00 sdate 2020-08-28 00:00:00 2020-08-28 00:00:00 30 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'MH', 'MH', 'MH', 'H', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-20 12:00:00 20200820.12 meteo-processing past forecast already completed itdate, istime 2020-08-20 18:00:00 20200820.18 meteo-processing past forecast already completed itdate, istime 2020-08-21 00:00:00 20200821.00 meteo-processing past forecast already completed itdate, istime 2020-08-21 06:00:00 20200821.06 meteo-processing past forecast already completed itdate, istime 2020-08-21 12:00:00 20200821.12 meteo-processing past forecast already completed itdate, istime 2020-08-21 18:00:00 20200821.18 meteo-processing past forecast already completed itdate, istime 2020-08-22 00:00:00 20200822.00 meteo-processing past forecast already completed itdate, istime 2020-08-22 06:00:00 20200822.06 meteo-processing past forecast already completed itdate, istime 2020-08-22 12:00:00 20200822.12 meteo-processing past forecast already completed itdate, istime 2020-08-22 18:00:00 20200822.18 meteo-processing past forecast already completed itdate, istime 2020-08-23 00:00:00 20200823.00 meteo-processing past forecast already completed itdate, istime 2020-08-23 06:00:00 20200823.06 meteo-processing past forecast already completed itdate, istime 2020-08-23 12:00:00 20200823.12 meteo-processing past forecast already completed itdate, istime 2020-08-23 18:00:00 20200823.18 meteo-processing past forecast already completed itdate, istime 2020-08-24 00:00:00 20200824.00 meteo-processing past forecast already completed itdate, istime 2020-08-24 06:00:00 20200824.06 meteo-processing past forecast already completed itdate, istime 2020-08-24 12:00:00 20200824.12 meteo-processing past forecast already completed itdate, istime 2020-08-24 18:00:00 20200824.18 -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt currDate 2020-08-24 18:00:00 f 18 nt-1 5 nt 6 currDate1 2020-08-24 18:00:00 2020-08-25 00:00:00 sdate 2020-08-25 00:00:00 2020-08-25 00:00:00 18 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.jpg -98.0 -75.0 262.0 285.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/ /mnt/input/grib_HWRF/2020/1000701/ input file /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 262.0 12.0 285.0 32.0 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt 262.025 284.975 12.025 31.975 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082418/all_inpData.txt currDate 2020-08-24 18:00:00 f 18 nt-1 71 nt 72 currDate1 2020-08-24 18:00:00 2020-08-27 18:00:00 sdate 2020-08-27 18:00:00 2020-08-27 18:00:00 29 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'MH', 'MH', 'MH', 'MH', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/20200825.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/ date: 2020-08-20 18:00:00 first date 20200820.18 remove maxtif alldate: DatetimeIndex(['2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00', '2020-08-24 18:00:00', '2020-08-25 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 18 date: 2020-08-21 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/10 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-21 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-22 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-23 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-24 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-25 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif stormname 1000701/14l stormname 1000701/14l TCbullsource 14l >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt 262.05 285.0 12.0 31.95 lon 460 lat 400 read TC track /mnt/output/GDACS/TC/TCTrack/1000701/HWRF/2020082500/all_inpData.txt currDate 2020-08-25 00:00:00 f 19 nt-1 71 nt 72 currDate1 2020-08-25 00:00:00 2020-08-28 00:00:00 sdate 2020-08-28 00:00:00 2020-08-28 00:00:00 30 CAT ['TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TD', 'TD', 'MH', 'MH', 'MH', 'H', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_res_stept0.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_res_stept0.tif. 0......10.10....20..20...30....30..40.....4050......5060......7060.....80..70....90...80....90...100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_stept0_clipped.tif. 0...Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_stept0_clipped.tif. 010......2010.....30...20..40.....5030......6040......7050......8060......7090......80...90...100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_stept0_clipped.tif. 0..Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_stept0_clipped.tif. 0..10.....1020......2030......4030......5040......50.60...60....70..70....80..80....90..90.....100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_res_all.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_all_clipped.tif. 0Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.12/20200820.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.12/20200820.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200820.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200820.18/20200820.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200820.18/20200820.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.00/20200821.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.00/20200821.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.06/20200821.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.06/20200821.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.12/20200821.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.12/20200821.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200821.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200821.18/20200821.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200821.18/20200821.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.00/20200822.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.00/20200822.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.06/20200822.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.06/20200822.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.12/20200822.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.12/20200822.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200822.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200822.18/20200822.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200822.18/20200822.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.00/20200823.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.00/20200823.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.06/20200823.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.06/20200823.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.12/20200823.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/Creating output file that is 2760P x 2400L. Processing input file /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2760P x 2400L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.12/20200823.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200823.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200823.18/20200823.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200823.18/20200823.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.00/20200824.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.00/20200824.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.06/20200824.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.06/20200824.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.12/20200824.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.12/20200824.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200824.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200824.18/20200824.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200824.18/20200824.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/20200825.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/20200825.00/20200825.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/20200825.00/20200825.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/20200825.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 262.025 11.975 285.025 31.975 HWRF /usr/bin/gdalwarp -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -97.975 11.975 -74.975 31.975 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-25 10:15:05.700165 UTC Case completed at: 2020-08-25 10:17:04.111737 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-25 10:25:11.966537 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-25 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-25 00:00:00 ndt: 108 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00', '2020-08-24 18:00:00', '2020-08-25 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-25 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-25 10:25:11.966537 UTC Case completed at: 2020-08-25 10:25:14.054692 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-25 10:35:10.036963 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-25 00:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif input file exist GDACS/1000701/2_HWRF 1000701 ndt: 19 it: 0 ndt: 19 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_72h.tif input file exist it: 1 ndt: 19 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_72h.tif input file exist it: 2 ndt: 19 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_72h.tif input file exist it: 3 ndt: 19 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_72h.tif input file exist it: 4 ndt: 19 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_72h.tif input file exist it: 5 ndt: 19 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_72h.tif input file exist it: 6 ndt: 19 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_72h.tif input file exist it: 7 ndt: 19 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_72h.tif input file exist it: 8 ndt: 19 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_72h.tif input file exist it: 9 ndt: 19 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_72h.tif input file exist it: 10 ndt: 19 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_72h.tif input file exist it: 11 ndt: 19 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_72h.tif input file exist it: 12 ndt: 19 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_72h.tif input file exist it: 13 ndt: 19 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_72h.tif input file exist it: 14 ndt: 19 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_72h.tif input file exist it: 15 ndt: 19 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_72h.tif it: 16 ndt: 19 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_72h.tif input file exist it: 17 ndt: 19 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_72h.tif input file exist it: 18 ndt: 19 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-20 12:00:00 currdate 2020-08-25 00:00:00 ndt: 108 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-20 12:00:00', '2020-08-20 18:00:00', '2020-08-21 00:00:00', '2020-08-21 06:00:00', '2020-08-21 12:00:00', '2020-08-21 18:00:00', '2020-08-22 00:00:00', '2020-08-22 06:00:00', '2020-08-22 12:00:00', '2020-08-22 18:00:00', '2020-08-23 00:00:00', '2020-08-23 06:00:00', '2020-08-23 12:00:00', '2020-08-23 18:00:00', '2020-08-24 00:00:00', '2020-08-24 06:00:00', '2020-08-24 12:00:00', '2020-08-24 18:00:00', '2020-08-25 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.0 -75.0 12.0 32.0 processing curr bull... 2020-08-25 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-25 10:35:10.036963 UTC Case completed at: 2020-08-25 10:35:12.324179 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-25 14:35:07.519662 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-25 06:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 20 it: 0 ndt: 20 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 20 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 20 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 20 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 20 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 20 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 20 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 20 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 20 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 20 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 20 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 20 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 20 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 20 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 20 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 20 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 20 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist it: 17 ndt: 20 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif input file exist it: 18 ndt: 20 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif input file exist it: 19 ndt: 20 idate: 2020-08-25 06:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000701/.2020082506.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/.2020082506.swath.rain_6h.tif home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-25 14:45:05.896820 UTC inp1= 20200820.12 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000701/14l submitting calc 2020-08-20 12:00:00 2020-08-25 06:00:00 delft3d -98.0 -75.0 12.0 32.0 4.0 HWRF 72 15 True GDACS/1000701/2_HWRF 6 1 False False 2 aa.txt 20200820.12 1000701/14l 6 rain False *************---------------------****************** GDACS/1000701/2_HWRF 1000701 ndt: 20 it: 0 ndt: 20 idate: 2020-08-20 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082012.swath.rain_6h.tif input file exist it: 1 ndt: 20 idate: 2020-08-20 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082018.swath.rain_6h.tif input file exist it: 2 ndt: 20 idate: 2020-08-21 00:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082100.swath.rain_6h.tif input file exist it: 3 ndt: 20 idate: 2020-08-21 06:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082106.swath.rain_6h.tif input file exist it: 4 ndt: 20 idate: 2020-08-21 12:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082112.swath.rain_6h.tif input file exist it: 5 ndt: 20 idate: 2020-08-21 18:00:00 /mnt/input/grib_HWRF/2020/1000701/fourteen14l.2020082118.swath.rain_6h.tif input file exist it: 6 ndt: 20 idate: 2020-08-22 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082200.swath.rain_6h.tif input file exist it: 7 ndt: 20 idate: 2020-08-22 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082206.swath.rain_6h.tif input file exist it: 8 ndt: 20 idate: 2020-08-22 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082212.swath.rain_6h.tif input file exist it: 9 ndt: 20 idate: 2020-08-22 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082218.swath.rain_6h.tif input file exist it: 10 ndt: 20 idate: 2020-08-23 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082300.swath.rain_6h.tif input file exist it: 11 ndt: 20 idate: 2020-08-23 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082306.swath.rain_6h.tif input file exist it: 12 ndt: 20 idate: 2020-08-23 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082312.swath.rain_6h.tif input file exist it: 13 ndt: 20 idate: 2020-08-23 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082318.swath.rain_6h.tif input file exist it: 14 ndt: 20 idate: 2020-08-24 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082400.swath.rain_6h.tif input file exist it: 15 ndt: 20 idate: 2020-08-24 06:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082406.swath.rain_6h.tif input file exist it: 16 ndt: 20 idate: 2020-08-24 12:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082412.swath.rain_6h.tif input file exist it: 17 ndt: 20 idate: 2020-08-24 18:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082418.swath.rain_6h.tif input file exist it: 18 ndt: 20 idate: 2020-08-25 00:00:00 /mnt/input/grib_HWRF/2020/1000701/marco14l.2020082500.swath.rain_6h.tif input file exist it: 19 ndt: 20 idate: 2020-08-25 06:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000701/.2020082506.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000701/.2020082506.swath.rain_6h.tif home dir /mnt/output/SSCS/2020/GDACS/1000701/2_HWRF/ ret -4 no impact estimation ==============================================================