Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 11:25:09.518707 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 00:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 00:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt currDate 2020-08-03 00:00:00 f 8 nt-1 5 nt 6 currDate1 2020-08-03 00:00:00 2020-08-03 06:00:00 sdate 2020-08-03 06:00:00 2020-08-03 06:00:00 8 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt currDate 2020-08-03 00:00:00 f 8 nt-1 71 nt 72 currDate1 2020-08-03 00:00:00 2020-08-06 00:00:00 sdate 2020-08-06 00:00:00 2020-08-06 00:00:00 19 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt currDate 2020-08-01 06:00:00 f 1 nt-1 5 nt 6 currDate1 2020-08-01 06:00:00 2020-08-01 12:00:00 sdate 2020-08-01 12:00:00 2020-08-01 12:00:00 1 CAT ['TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080106/all_inpData.txt currDate 2020-08-01 06:00:00 f 1 nt-1 71 nt 72 currDate1 2020-08-01 06:00:00 2020-08-04 06:00:00 sdate 2020-08-04 06:00:00 2020-08-04 06:00:00 12 CAT ['TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH', 'MH', 'H', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg itdate, istime 2020-08-01 12:00:00 20200801.12 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt currDate 2020-08-01 12:00:00 f 2 nt-1 5 nt 6 currDate1 2020-08-01 12:00:00 2020-08-01 18:00:00 sdate 2020-08-01 18:00:00 2020-08-01 18:00:00 2 CAT ['TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080112/all_inpData.txt currDate 2020-08-01 12:00:00 f 2 nt-1 71 nt 72 currDate1 2020-08-01 12:00:00 2020-08-04 12:00:00 sdate 2020-08-04 12:00:00 2020-08-04 12:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS', 'H', 'TS', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg itdate, istime 2020-08-01 18:00:00 20200801.18 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt currDate 2020-08-01 18:00:00 f 3 nt-1 5 nt 6 currDate1 2020-08-01 18:00:00 2020-08-02 00:00:00 sdate 2020-08-02 00:00:00 2020-08-02 00:00:00 3 CAT ['TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080118/all_inpData.txt currDate 2020-08-01 18:00:00 f 3 nt-1 71 nt 72 currDate1 2020-08-01 18:00:00 2020-08-04 18:00:00 sdate 2020-08-04 18:00:00 2020-08-04 18:00:00 14 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg itdate, istime 2020-08-02 00:00:00 20200802.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/202008Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 02.00/20200802.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt currDate 2020-08-02 00:00:00 f 4 nt-1 5 nt 6 currDate1 2020-08-02 00:00:00 2020-08-02 06:00:00 sdate 2020-08-02 06:00:00 2020-08-02 06:00:00 4 CAT ['TD', 'TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080200/all_inpData.txt currDate 2020-08-02 00:00:00 f 4 nt-1 71 nt 72 currDate1 2020-08-02 00:00:00 2020-08-05 00:00:00 sdate 2020-08-05 00:00:00 2020-08-05 00:00:00 15 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg itdate, istime 2020-08-02 06:00:00 20200802.06 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt currDate 2020-08-02 06:00:00 f 5 nt-1 5 nt 6 currDate1 2020-08-02 06:00:00 2020-08-02 12:00:00 sdate 2020-08-02 12:00:00 2020-08-02 12:00:00 5 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080206/all_inpData.txt currDate 2020-08-02 06:00:00 f 5 nt-1 71 nt 72 currDate1 2020-08-02 06:00:00 2020-08-05 06:00:00 sdate 2020-08-05 06:00:00 2020-08-05 06:00:00 16 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg itdate, istime 2020-08-02 12:00:00 20200802.12 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt currDate 2020-08-02 12:00:00 f 6 nt-1 5 nt 6 currDate1 2020-08-02 12:00:00 2020-08-02 18:00:00 sdate 2020-08-02 18:00:00 2020-08-02 18:00:00 6 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080212/all_inpData.txt currDate 2020-08-02 12:00:00 f 6 nt-1 71 nt 72 currDate1 2020-08-02 12:00:00 2020-08-05 12:00:00 sdate 2020-08-05 12:00:00 2020-08-05 12:00:00 17 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg itdate, istime 2020-08-02 18:00:00 20200802.18 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt currDate 2020-08-02 18:00:00 f 7 nt-1 5 nt 6 currDate1 2020-08-02 18:00:00 2020-08-03 00:00:00 sdate 2020-08-03 00:00:00 2020-08-03 00:00:00 7 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080218/all_inpData.txt currDate 2020-08-02 18:00:00 f 7 nt-1 71 nt 72 currDate1 2020-08-02 18:00:00 2020-08-05 18:00:00 sdate 2020-08-05 18:00:00 2020-08-05 18:00:00 18 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200803.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 8 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080300/all_inpData.txt currDate 2020-08-03 00:00:00 f 8 nt-1 71 nt 72 currDate1 2020-08-03 00:00:00 2020-08-06 00:00:00 sdate 2020-08-06 00:00:00 2020-08-06 00:00:00 19 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_res_stept0.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_res_stept0.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......80.80....90..90.....100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml >> 7. remove files done lim core Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_res_stept0.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_res_stept0.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_res_stept0.tif. 0.........101010........20.20.20.......30.30.30.......40.40.40.......50.50.50.......60.60.60.......70.70.70.......80.80.80.......90.90.90........100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_stept0_clipped.tif. 0...Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_stept0_clipped.tif. 0...10...10...10...20...20...20...30..30....30...40...40...40...50...50...50...60...60...60...70...70...70...80...80....80.90....90...90......100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_stept0_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml >> 7. remove files done lim core Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_res_stept0.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_res_stept0.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_res_stept0.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_stept0_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_stept0_clipped.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_stept0_clipped.tif. 0.....10.10....10....20.20....20....30.30....30....40.40....40....50.50....50...60...60....60.70....70....70.80...80......8090...90......90....100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_stept0_clipped.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_stept0_clipped.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_stept0_clipped.tif. 010......10...20.10....20...30...20...30...40...30..40....50....40.50....60...50...60...70...60...70...80...70....80.90....80....90....90....100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml >> 7. remove files done lim core t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_res_all.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_all_clipped.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_all_clipped.tif. 0.10.....10..20....20..30....30..40.....4050......5060......6070......7080......8090......90...100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_all_clipped.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_all_clipped.tif. 0..10.....1020......3020......4030......5040......6050......7060......8070......9080......90...100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml >> 7. remove files done lim core Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_res_all.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_res_all.tif. 0....Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_res_all.tif. 0...1010......10...2020......20...3030......30...4040......40...5050......50...6060......60...7070......70...8080......80...9090......90.....100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_all_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_all_clipped.tif. 0....Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_all_clipped.tif. 0...1010......10...2020......20...3030.......30.40.40.......4050...50......5060...60......7060...70.....80.70....80...90...80...90.....90....100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_all_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_all_clipped.tif. 0...Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_all_clipped.tif. 0....1010.......10.20.20.......20.30.30........304040.........405050.........506060.........607070.........708080.........809090.........90...100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml >> 7. remove files done lim core Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_res_all.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_res_all.tif. 0..Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_res_all.tif. 0......1010...10.....20.20....20....30.30.....30...4040......40...5050......50...6060......60...7070......70...8080......80...9090......90.....100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_all_clipped.tif. 0.Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_all_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_all_clipped.tif. 0.....10....10.10....20.....2020...30......3030...40......4040...50......5050...60......6060...70......7070...80......80.80.90.......90.90......100 - done. 100 - done. 100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_all_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_all_clipped.tif. 0Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_all_clipped.tif. 0.......10...1010......20...2020......30...3030......40...4040......50...5050......60...6060......70...7070......80....8080...90......9090.......100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. lim core t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200803.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 11:25:09.518707 UTC Case completed at: 2020-08-03 11:30:12.741863 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 11:35:05.394433 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 00:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 11:35:05.394433 UTC Case completed at: 2020-08-03 11:35:05.837718 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 11:45:06.383450 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 00:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 11:45:06.383450 UTC Case completed at: 2020-08-03 11:45:07.142609 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 11:55:09.110239 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 9 it: 0 ndt: 9 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 9 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 9 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 9 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 9 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 9 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 9 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 9 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 9 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 00:00:00 ndt: 48 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 11:55:09.110239 UTC Case completed at: 2020-08-03 11:55:09.517418 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 13:45:05.258424 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 06:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 10 it: 0 ndt: 10 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 10 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 10 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 10 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 10 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 10 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 10 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 10 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 10 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 10 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 10 it: 0 ndt: 10 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 10 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 10 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 10 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 10 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 10 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 10 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 10 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 10 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 10 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 06:00:00 ndt: 54 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 06:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt currDate 2020-08-03 06:00:00 f 9 nt-1 5 nt 6 currDate1 2020-08-03 06:00:00 2020-08-03 12:00:00 sdate 2020-08-03 12:00:00 2020-08-03 12:00:00 9 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt currDate 2020-08-03 06:00:00 f 9 nt-1 71 nt 72 currDate1 2020-08-03 06:00:00 2020-08-06 06:00:00 sdate 2020-08-06 06:00:00 2020-08-06 06:00:00 20 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200803.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 9 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080306/all_inpData.txt currDate 2020-08-03 06:00:00 f 9 nt-1 71 nt 72 currDate1 2020-08-03 06:00:00 2020-08-06 06:00:00 sdate 2020-08-06 06:00:00 2020-08-06 06:00:00 20 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200803.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 13:45:05.258424 UTC Case completed at: 2020-08-03 13:46:38.237156 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 13:55:09.036134 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 06:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 10 it: 0 ndt: 10 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 10 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 10 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 10 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 10 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 10 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 10 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 10 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 10 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 10 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 10 it: 0 ndt: 10 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 10 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 10 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 10 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 10 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 10 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 10 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 10 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 10 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 10 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 06:00:00 ndt: 54 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 06:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 13:55:09.036134 UTC Case completed at: 2020-08-03 13:55:09.401268 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 21:05:05.614766 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 12:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 12:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 12:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt currDate 2020-08-03 12:00:00 f 10 nt-1 5 nt 6 currDate1 2020-08-03 12:00:00 2020-08-03 18:00:00 sdate 2020-08-03 18:00:00 2020-08-03 18:00:00 10 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt currDate 2020-08-03 12:00:00 f 10 nt-1 71 nt 72 currDate1 2020-08-03 12:00:00 2020-08-06 12:00:00 sdate 2020-08-06 12:00:00 2020-08-06 12:00:00 21 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200803.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 10 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080312/all_inpData.txt currDate 2020-08-03 12:00:00 f 10 nt-1 71 nt 72 currDate1 2020-08-03 12:00:00 2020-08-06 12:00:00 sdate 2020-08-06 12:00:00 2020-08-06 12:00:00 21 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS', 'TS', 'TS', 'TD', 'TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200803.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 21:05:05.614766 UTC Case completed at: 2020-08-03 21:06:52.505229 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 21:15:14.264326 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 12:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 12:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 21:15:14.264326 UTC Case completed at: 2020-08-03 21:15:15.765047 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-03 21:25:10.222439 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 12:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 11 it: 0 ndt: 11 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 11 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 11 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 11 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 11 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 11 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 11 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 11 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 11 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 11 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 11 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 12:00:00 ndt: 60 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-03 21:25:10.222439 UTC Case completed at: 2020-08-03 21:25:10.854773 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 01:15:06.166413 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 18:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 12 it: 0 ndt: 12 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 12 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 12 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 12 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 12 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 12 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 12 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 12 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 12 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 12 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 12 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 12 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 12 it: 0 ndt: 12 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 12 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 12 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 12 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 12 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 12 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 12 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 12 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 12 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 12 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 12 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 12 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 18:00:00 ndt: 66 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 18:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt currDate 2020-08-03 18:00:00 f 11 nt-1 5 nt 6 currDate1 2020-08-03 18:00:00 2020-08-04 00:00:00 sdate 2020-08-04 00:00:00 2020-08-04 00:00:00 11 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt currDate 2020-08-03 18:00:00 f 11 nt-1 71 nt 72 currDate1 2020-08-03 18:00:00 2020-08-06 18:00:00 sdate 2020-08-06 18:00:00 2020-08-06 18:00:00 22 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200803.18_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 11 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080318/all_inpData.txt currDate 2020-08-03 18:00:00 f 11 nt-1 71 nt 72 currDate1 2020-08-03 18:00:00 2020-08-06 18:00:00 sdate 2020-08-06 18:00:00 2020-08-06 18:00:00 22 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200803.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 01:15:06.166413 UTC Case completed at: 2020-08-04 01:16:40.473218 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 01:25:09.139512 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-03 18:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 12 it: 0 ndt: 12 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 12 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 12 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 12 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 12 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 12 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 12 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 12 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 12 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 12 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 12 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 12 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 12 it: 0 ndt: 12 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 12 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 12 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 12 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 12 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 12 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 12 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 12 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 12 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 12 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 12 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 12 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-03 18:00:00 ndt: 66 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-03 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 01:25:09.139512 UTC Case completed at: 2020-08-04 01:25:09.813743 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 07:25:10.427205 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 13 it: 0 ndt: 13 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 13 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 13 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 13 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 13 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 13 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 13 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 13 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 13 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 13 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 13 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 13 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 13 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 13 it: 0 ndt: 13 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 13 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 13 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 13 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 13 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 13 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 13 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 13 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 13 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 13 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 13 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 13 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 13 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 00:00:00 ndt: 72 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 00:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt currDate 2020-08-04 00:00:00 f 12 nt-1 5 nt 6 currDate1 2020-08-04 00:00:00 2020-08-04 06:00:00 sdate 2020-08-04 06:00:00 2020-08-04 06:00:00 12 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt currDate 2020-08-04 00:00:00 f 12 nt-1 71 nt 72 currDate1 2020-08-04 00:00:00 2020-08-07 00:00:00 sdate 2020-08-07 00:00:00 2020-08-07 00:00:00 23 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed itdate, istime 2020-08-03 18:00:00 20200803.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200804.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 12 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080400/all_inpData.txt currDate 2020-08-04 00:00:00 f 12 nt-1 71 nt 72 currDate1 2020-08-04 00:00:00 2020-08-07 00:00:00 sdate 2020-08-07 00:00:00 2020-08-07 00:00:00 23 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/20200804.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200804.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWCreating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. RF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 07:25:10.427205 UTC Case completed at: 2020-08-04 07:26:47.365156 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 07:35:04.847951 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 13 it: 0 ndt: 13 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 13 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 13 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 13 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 13 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 13 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 13 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 13 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 13 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 13 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 13 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 13 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 13 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 13 it: 0 ndt: 13 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 13 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 13 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 13 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 13 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 13 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 13 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 13 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 13 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 13 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 13 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 13 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 13 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 00:00:00 ndt: 72 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 07:35:04.847951 UTC Case completed at: 2020-08-04 07:35:05.329999 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 13:15:05.944768 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 06:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 14 it: 0 ndt: 14 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 14 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 14 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 14 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 14 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 14 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 14 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 14 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 14 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 14 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 14 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 14 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 14 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 14 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 14 it: 0 ndt: 14 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 14 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 14 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 14 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 14 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 14 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 14 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 14 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 14 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 14 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 14 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 14 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 14 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 14 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 06:00:00 ndt: 78 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 06:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt currDate 2020-08-04 06:00:00 f 13 nt-1 5 nt 6 currDate1 2020-08-04 06:00:00 2020-08-04 12:00:00 sdate 2020-08-04 12:00:00 2020-08-04 12:00:00 13 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt currDate 2020-08-04 06:00:00 f 13 nt-1 71 nt 72 currDate1 2020-08-04 06:00:00 2020-08-07 06:00:00 sdate 2020-08-07 06:00:00 2020-08-07 06:00:00 24 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed itdate, istime 2020-08-03 18:00:00 20200803.18 meteo-processing past forecast already completed itdate, istime 2020-08-04 00:00:00 20200804.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200804.06_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 13 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080406/all_inpData.txt currDate 2020-08-04 06:00:00 f 13 nt-1 71 nt 72 currDate1 2020-08-04 06:00:00 2020-08-07 06:00:00 sdate 2020-08-07 06:00:00 2020-08-07 06:00:00 24 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/20200804.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.jpg iCreating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. n: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/20200804.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200804.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 13:15:05.944768 UTC Case completed at: 2020-08-04 13:16:39.655229 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 13:25:09.472607 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 06:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 14 it: 0 ndt: 14 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 14 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 14 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 14 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 14 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 14 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 14 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 14 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 14 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 14 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 14 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 14 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 14 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 14 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 14 it: 0 ndt: 14 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 14 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 14 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 14 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 14 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 14 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 14 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 14 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 14 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 14 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 14 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 14 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 14 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 14 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 06:00:00 ndt: 78 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 06:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 13:25:09.472607 UTC Case completed at: 2020-08-04 13:25:10.192143 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 19:35:05.394694 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 12:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 15 it: 0 ndt: 15 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 15 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 15 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 15 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 15 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 15 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 15 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 15 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 15 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 15 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 15 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 15 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 15 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 15 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 15 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 15 it: 0 ndt: 15 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 15 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 15 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 15 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 15 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 15 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 15 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 15 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 15 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 15 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 15 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 15 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 15 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 15 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 15 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 12:00:00 ndt: 84 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 12:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt currDate 2020-08-04 12:00:00 f 14 nt-1 5 nt 6 currDate1 2020-08-04 12:00:00 2020-08-04 18:00:00 sdate 2020-08-04 18:00:00 2020-08-04 18:00:00 14 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt currDate 2020-08-04 12:00:00 f 14 nt-1 71 nt 72 currDate1 2020-08-04 12:00:00 2020-08-07 12:00:00 sdate 2020-08-07 12:00:00 2020-08-07 12:00:00 25 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed itdate, istime 2020-08-03 18:00:00 20200803.18 meteo-processing past forecast already completed itdate, istime 2020-08-04 00:00:00 20200804.00 meteo-processing past forecast already completed itdate, istime 2020-08-04 06:00:00 20200804.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200804.12_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 14 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080412/all_inpData.txt currDate 2020-08-04 12:00:00 f 14 nt-1 71 nt 72 currDate1 2020-08-04 12:00:00 2020-08-07 12:00:00 sdate 2020-08-07 12:00:00 2020-08-07 12:00:00 25 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/20200804.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.jpg iCreating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. n: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/20200804.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/20200804.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200804.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 19:35:05.394694 UTC Case completed at: 2020-08-04 19:36:39.554257 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-04 19:45:06.031514 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 12:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 15 it: 0 ndt: 15 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 15 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 15 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 15 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 15 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 15 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 15 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 15 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 15 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 15 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 15 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 15 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 15 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 15 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 15 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 15 it: 0 ndt: 15 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 15 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 15 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 15 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 15 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 15 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 15 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 15 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 15 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 15 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 15 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 15 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 15 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 15 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 15 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 12:00:00 ndt: 84 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-04 19:45:06.031514 UTC Case completed at: 2020-08-04 19:45:07.099199 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-05 01:15:05.464116 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 18:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 16 it: 0 ndt: 16 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 16 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 16 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 16 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 16 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 16 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 16 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 16 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 16 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 16 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 16 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 16 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 16 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 16 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 16 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist it: 15 ndt: 16 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 16 it: 0 ndt: 16 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 16 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 16 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 16 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 16 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 16 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 16 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 16 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 16 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 16 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 16 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 16 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 16 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 16 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 16 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist it: 15 ndt: 16 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 18:00:00 ndt: 90 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 18:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/ /mnt/input/grib_HWRF/2020/1000688/ Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-05 01:25:10.202013 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-04 18:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 16 it: 0 ndt: 16 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 16 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 16 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 16 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 16 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 16 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 16 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 16 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 16 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 16 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 16 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 16 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 16 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 16 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 16 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist it: 15 ndt: 16 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 16 it: 0 ndt: 16 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 16 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 16 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 16 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 16 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 16 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 16 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 16 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 16 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 16 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 16 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 16 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 16 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 16 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 16 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist it: 15 ndt: 16 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-04 18:00:00 ndt: 90 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-04 18:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt currDate 2020-08-04 18:00:00 f 15 nt-1 5 nt 6 currDate1 2020-08-04 18:00:00 2020-08-05 00:00:00 sdate 2020-08-05 00:00:00 2020-08-05 00:00:00 15 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt currDate 2020-08-04 18:00:00 f 15 nt-1 71 nt 72 currDate1 2020-08-04 18:00:00 2020-08-07 18:00:00 sdate 2020-08-07 18:00:00 2020-08-07 18:00:00 26 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed itdate, istime 2020-08-03 18:00:00 20200803.18 meteo-processing past forecast already completed itdate, istime 2020-08-04 00:00:00 20200804.00 meteo-processing past forecast already completed itdate, istime 2020-08-04 06:00:00 20200804.06 meteo-processing past forecast already completed itdate, istime 2020-08-04 12:00:00 20200804.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200804.18_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 15 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080418/all_inpData.txt currDate 2020-08-04 18:00:00 f 15 nt-1 71 nt 72 currDate1 2020-08-04 18:00:00 2020-08-07 18:00:00 sdate 2020-08-07 18:00:00 2020-08-07 18:00:00 26 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/20200804.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.jpg iCreating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. n: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/20200804.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/20200804.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/20200804.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200804.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-05 01:25:10.202013 UTC Case completed at: 2020-08-05 01:26:35.531430 UTC **********E N D O F J O B*********************** Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 360P x 450L. Processing input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-05 07:35:05.646686 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-05 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 17 it: 0 ndt: 17 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 17 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 17 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 17 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 17 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 17 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 17 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 17 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 17 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 17 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 17 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 17 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 17 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 17 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 17 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist it: 15 ndt: 17 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif input file exist it: 16 ndt: 17 idate: 2020-08-05 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 17 it: 0 ndt: 17 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 17 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 17 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 17 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 17 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 17 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 17 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 17 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 17 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 17 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 17 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 17 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 17 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 17 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 17 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist it: 15 ndt: 17 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif input file exist it: 16 ndt: 17 idate: 2020-08-05 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-05 00:00:00 ndt: 96 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00', '2020-08-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-05 00:00:00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt currDate 2020-08-05 00:00:00 f 16 nt-1 5 nt 6 currDate1 2020-08-05 00:00:00 2020-08-05 06:00:00 sdate 2020-08-05 06:00:00 2020-08-05 06:00:00 16 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.jpg 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/ /mnt/input/grib_HWRF/2020/1000688/ input file /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 116.0 18.0 134.0 40.5 -dstnodata 0 "/mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif" outFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif dd: 0.05 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt 116.025 133.975 18.025 40.475 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt currDate 2020-08-05 00:00:00 f 16 nt-1 71 nt 72 currDate1 2020-08-05 00:00:00 2020-08-08 00:00:00 sdate 2020-08-08 00:00:00 2020-08-08 00:00:00 27 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-08-01 00:00:00 20200801.00 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing 116.0 134.0 116.0 134.0 0.05 0.05 /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/ /mnt/input/grib_HWRF/2020/1000688/ meteo files not yet existing itdate, istime 2020-08-01 06:00:00 20200801.06 meteo-processing past forecast already completed itdate, istime 2020-08-01 12:00:00 20200801.12 meteo-processing past forecast already completed itdate, istime 2020-08-01 18:00:00 20200801.18 meteo-processing past forecast already completed itdate, istime 2020-08-02 00:00:00 20200802.00 meteo-processing past forecast already completed itdate, istime 2020-08-02 06:00:00 20200802.06 meteo-processing past forecast already completed itdate, istime 2020-08-02 12:00:00 20200802.12 meteo-processing past forecast already completed itdate, istime 2020-08-02 18:00:00 20200802.18 meteo-processing past forecast already completed itdate, istime 2020-08-03 00:00:00 20200803.00 meteo-processing past forecast already completed itdate, istime 2020-08-03 06:00:00 20200803.06 meteo-processing past forecast already completed itdate, istime 2020-08-03 12:00:00 20200803.12 meteo-processing past forecast already completed itdate, istime 2020-08-03 18:00:00 20200803.18 meteo-processing past forecast already completed itdate, istime 2020-08-04 00:00:00 20200804.00 meteo-processing past forecast already completed itdate, istime 2020-08-04 06:00:00 20200804.06 meteo-processing past forecast already completed itdate, istime 2020-08-04 12:00:00 20200804.12 meteo-processing past forecast already completed itdate, istime 2020-08-04 18:00:00 20200804.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/20200805.00_Final_completed_rain.txt FINAL /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/ date: 2020-08-01 06:00:00 first date 20200801.06 remove maxtif alldate: DatetimeIndex(['2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00', '2020-08-05 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 16 date: 2020-08-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-01 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-02 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-04 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/10006880 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done /2_HWRF/tif/20200804.18/20200804.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-08-05 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif stormname 1000688/03w stormname 1000688/03w TCbullsource 03w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt 116.05 134.0 18.0 40.45 lon 360 lat 450 read TC track /mnt/output/GDACS/TC/TCTrack/1000688/HWRF/2020080500/all_inpData.txt currDate 2020-08-05 00:00:00 f 16 nt-1 71 nt 72 currDate1 2020-08-05 00:00:00 2020-08-08 00:00:00 sdate 2020-08-08 00:00:00 2020-08-08 00:00:00 27 CAT ['TD', 'TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'H', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain_stept0.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) file not exist /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.00/20200801.00_rain.tif Creating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_all.xml >> 7. remove files done t0 completed ============================================ 4. Copy files ============================================ check t0 xml check all xml >> !!!! Check Copy !!!! , listfiles_copy , listfiles_all all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.00/20200801.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.06/20200801.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.06/20200801.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.12/20200801.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.12/20200801.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200801.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200801.18/20200801.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200801.18/20200801.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.00/20200802.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.00/20200802.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.06/20200802.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.06/20200802.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.12/20200802.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.12/20200802.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200802.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200802.18/20200802.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200802.18/20200802.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.00/20200803.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.00/20200803.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.06/20200803.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.06/20200803.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.12/20200803.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.12/20200803.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200803.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200803.18/20200803.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200803.18/20200803.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.00/20200804.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.00/20200804.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.06/20200804.06_rain.jpg iCreating output file that is 2160P x 2700L. Processing input file /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 2160P x 2700L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. n: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.06/20200804.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.12/20200804.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.12/20200804.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200804.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200804.18/20200804.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200804.18/20200804.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/20200805.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/20200805.00/20200805.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/20200805.00/20200805.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/20200805.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (HWRF) OutDir: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 116.025 17.975 134.025 40.475 HWRF /usr/bin/gdalwarp -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 116.025 17.975 134.025 40.475 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-05 07:35:05.646686 UTC Case completed at: 2020-08-05 07:36:40.920790 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-08-05 07:45:06.203832 UTC inp1= 20200801.00 ncores= 2 var= rain lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000688/03w submitting calc 2020-08-01 00:00:00 2020-08-05 00:00:00 delft3d 116.0 134.0 18.0 40.5 4.0 HWRF 72 15 True GDACS/1000688/2_HWRF 6 1 False False 2 aa.txt 20200801.00 1000688/03w 6 rain False *************---------------------****************** GDACS/1000688/2_HWRF 1000688 ndt: 17 it: 0 ndt: 17 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_6h.tif it: 1 ndt: 17 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_6h.tif input file exist it: 2 ndt: 17 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_6h.tif input file exist it: 3 ndt: 17 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_6h.tif input file exist it: 4 ndt: 17 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_6h.tif input file exist it: 5 ndt: 17 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_6h.tif input file exist it: 6 ndt: 17 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_6h.tif input file exist it: 7 ndt: 17 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_6h.tif input file exist it: 8 ndt: 17 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_6h.tif input file exist it: 9 ndt: 17 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_6h.tif input file exist it: 10 ndt: 17 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_6h.tif input file exist it: 11 ndt: 17 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_6h.tif input file exist it: 12 ndt: 17 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_6h.tif input file exist it: 13 ndt: 17 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_6h.tif input file exist it: 14 ndt: 17 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_6h.tif input file exist it: 15 ndt: 17 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_6h.tif input file exist it: 16 ndt: 17 idate: 2020-08-05 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_6h.tif input file exist GDACS/1000688/2_HWRF 1000688 ndt: 17 it: 0 ndt: 17 idate: 2020-08-01 00:00:00 meteo files not yet existing /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif ********* ------ >input file doesn't exist /mnt/input/grib_HWRF/2020/1000688/.2020080100.swath.rain_72h.tif it: 1 ndt: 17 idate: 2020-08-01 06:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080106.swath.rain_72h.tif input file exist it: 2 ndt: 17 idate: 2020-08-01 12:00:00 /mnt/input/grib_HWRF/2020/1000688/three03w.2020080112.swath.rain_72h.tif input file exist it: 3 ndt: 17 idate: 2020-08-01 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080118.swath.rain_72h.tif input file exist it: 4 ndt: 17 idate: 2020-08-02 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080200.swath.rain_72h.tif input file exist it: 5 ndt: 17 idate: 2020-08-02 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080206.swath.rain_72h.tif input file exist it: 6 ndt: 17 idate: 2020-08-02 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080212.swath.rain_72h.tif input file exist it: 7 ndt: 17 idate: 2020-08-02 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080218.swath.rain_72h.tif input file exist it: 8 ndt: 17 idate: 2020-08-03 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080300.swath.rain_72h.tif input file exist it: 9 ndt: 17 idate: 2020-08-03 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080306.swath.rain_72h.tif input file exist it: 10 ndt: 17 idate: 2020-08-03 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080312.swath.rain_72h.tif input file exist it: 11 ndt: 17 idate: 2020-08-03 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080318.swath.rain_72h.tif input file exist it: 12 ndt: 17 idate: 2020-08-04 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080400.swath.rain_72h.tif input file exist it: 13 ndt: 17 idate: 2020-08-04 06:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080406.swath.rain_72h.tif input file exist it: 14 ndt: 17 idate: 2020-08-04 12:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080412.swath.rain_72h.tif input file exist it: 15 ndt: 17 idate: 2020-08-04 18:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080418.swath.rain_72h.tif input file exist it: 16 ndt: 17 idate: 2020-08-05 00:00:00 /mnt/input/grib_HWRF/2020/1000688/hagupit03w.2020080500.swath.rain_72h.tif input file exist home dir /mnt/output/SSCS/2020/GDACS/1000688/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-08-01 00:00:00 currdate 2020-08-05 00:00:00 ndt: 96 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-08-01 00:00:00', '2020-08-01 06:00:00', '2020-08-01 12:00:00', '2020-08-01 18:00:00', '2020-08-02 00:00:00', '2020-08-02 06:00:00', '2020-08-02 12:00:00', '2020-08-02 18:00:00', '2020-08-03 00:00:00', '2020-08-03 06:00:00', '2020-08-03 12:00:00', '2020-08-03 18:00:00', '2020-08-04 00:00:00', '2020-08-04 06:00:00', '2020-08-04 12:00:00', '2020-08-04 18:00:00', '2020-08-05 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 116.0 134.0 18.0 40.5 processing curr bull... 2020-08-05 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-08-05 07:45:06.203832 UTC Case completed at: 2020-08-05 07:45:07.547943 UTC **********E N D O F J O B***********************