Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:05:08.548282 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 5 nt 6 currDate1 2019-11-26 00:00:00 2019-11-26 06:00:00 sdate 2019-11-26 06:00:00 2019-11-26 06:00:00 2 CAT ['TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 71 nt 72 currDate1 2019-11-26 00:00:00 2019-11-29 00:00:00 sdate 2019-11-29 00:00:00 2019-11-29 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt currDate 2019-11-25 18:00:00 f 1 nt-1 5 nt 6 currDate1 2019-11-25 18:00:00 2019-11-26 00:00:00 sdate 2019-11-26 00:00:00 2019-11-26 00:00:00 1 CAT ['TD', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt currDate 2019-11-25 18:00:00 f 1 nt-1 71 nt 72 currDate1 2019-11-25 18:00:00 2019-11-28 18:00:00 sdate 2019-11-28 18:00:00 2019-11-28 18:00:00 12 CAT ['TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 alldate: DatetimeIndex(['2019-11-26'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 71 nt 72 currDate1 2019-11-26 00:00:00 2019-11-29 00:00:00 sdate 2019-11-29 00:00:00 2019-11-29 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_res_stept0.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_res_stept0.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_stept0_clipped.tif. 0...10Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_stept0_clipped.tif. 0......2010.....30..20....40..30.....40...50...6050.....70..60....80..70....90..80.....90...100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_stept0_clipped.tif. 0...10Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_stept0_clipped.tif. 0.....20...10..30....20..40....30..50....40..60....50..70....60..80....70..90....80....90...100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_res_all.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_all_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......50.50....60...60..70....70..80....80..90....90....100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_all_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:05:08.548282 UTC Case completed at: 2019-11-26 09:07:30.167342 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:15:10.378319 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:15:10.378319 UTC Case completed at: 2019-11-26 09:15:10.678036 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:25:11.548575 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:25:11.548575 UTC Case completed at: 2019-11-26 09:25:11.738354 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:05:07.448306 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 5 nt 6 currDate1 2019-11-26 06:00:00 2019-11-26 12:00:00 sdate 2019-11-26 12:00:00 2019-11-26 12:00:00 3 CAT ['TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 71 nt 72 currDate1 2019-11-26 06:00:00 2019-11-29 06:00:00 sdate 2019-11-29 06:00:00 2019-11-29 06:00:00 14 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 71 nt 72 currDate1 2019-11-26 06:00:00 2019-11-29 06:00:00 sdate 2019-11-29 06:00:00 2019-11-29 06:00:00 14 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:05:07.448306 UTC Case completed at: 2019-11-26 13:07:11.677522 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:15:06.855916 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:15:06.855916 UTC Case completed at: 2019-11-26 13:15:07.082008 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:25:10.274253 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:25:10.274253 UTC Case completed at: 2019-11-26 13:25:10.434029 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:05:11.764894 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 5 nt 6 currDate1 2019-11-26 12:00:00 2019-11-26 18:00:00 sdate 2019-11-26 18:00:00 2019-11-26 18:00:00 4 CAT ['TD', 'TD', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 71 nt 72 currDate1 2019-11-26 12:00:00 2019-11-29 12:00:00 sdate 2019-11-29 12:00:00 2019-11-29 12:00:00 15 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 71 nt 72 currDate1 2019-11-26 12:00:00 2019-11-29 12:00:00 sdate 2019-11-29 12:00:00 2019-11-29 12:00:00 15 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:05:11.764894 UTC Case completed at: 2019-11-26 19:07:21.365320 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:15:05.804055 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:15:05.804055 UTC Case completed at: 2019-11-26 19:15:05.984859 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:25:15.612156 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:25:15.612156 UTC Case completed at: 2019-11-26 19:25:15.862651 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:05:06.614023 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 5 nt 6 currDate1 2019-11-26 18:00:00 2019-11-27 00:00:00 sdate 2019-11-27 00:00:00 2019-11-27 00:00:00 5 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 71 nt 72 currDate1 2019-11-26 18:00:00 2019-11-29 18:00:00 sdate 2019-11-29 18:00:00 2019-11-29 18:00:00 16 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed itdate, istime 2019-11-26 12:00:00 20191126.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.18_Final_completed_rain.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-26 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 71 nt 72 currDate1 2019-11-26 18:00:00 2019-11-29 18:00:00 sdate 2019-11-29 18:00:00 2019-11-29 18:00:00 16 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/20191126.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:05:06.614023 UTC Case completed at: 2019-11-27 01:07:05.648909 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:15:06.319007 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:15:06.319007 UTC Case completed at: 2019-11-27 01:15:06.617108 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:25:10.904848 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:25:10.904848 UTC Case completed at: 2019-11-27 01:25:11.227898 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 09:55:11.126609 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 5 nt 6 currDate1 2019-11-27 00:00:00 2019-11-27 06:00:00 sdate 2019-11-27 06:00:00 2019-11-27 06:00:00 6 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 71 nt 72 currDate1 2019-11-27 00:00:00 2019-11-30 00:00:00 sdate 2019-11-30 00:00:00 2019-11-30 00:00:00 17 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'MH', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed itdate, istime 2019-11-26 12:00:00 20191126.12 meteo-processing past forecast already completed itdate, istime 2019-11-26 18:00:00 20191126.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191127.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-26 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2019-11-27 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 71 nt 72 currDate1 2019-11-27 00:00:00 2019-11-30 00:00:00 sdate 2019-11-30 00:00:00 2019-11-30 00:00:00 17 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'MH', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/20191126.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_rain.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/20191127.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191127.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 09:55:11.126609 UTC Case completed at: 2019-11-27 09:57:23.183125 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 10:05:07.324694 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 10:05:07.324694 UTC Case completed at: 2019-11-27 10:05:07.822535 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 10:15:06.673512 UTC inp1= 20191125.18 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 2 aa.txt 20191125.18 1000636/29w 6 rain False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.rain_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.rain_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.rain_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.rain_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.rain_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 10:15:06.673512 UTC Case completed at: 2019-11-27 10:15:07.177229 UTC **********E N D O F J O B***********************