Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:05:08.547869 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 5 nt 6 currDate1 2019-11-26 00:00:00 2019-11-26 06:00:00 sdate 2019-11-26 06:00:00 2019-11-26 06:00:00 2 CAT ['TD', 'TD', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 71 nt 72 currDate1 2019-11-26 00:00:00 2019-11-29 00:00:00 sdate 2019-11-29 00:00:00 2019-11-29 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt currDate 2019-11-25 18:00:00 f 1 nt-1 5 nt 6 currDate1 2019-11-25 18:00:00 2019-11-26 00:00:00 sdate 2019-11-26 00:00:00 2019-11-26 00:00:00 1 CAT ['TD', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112518/all_inpData.txt currDate 2019-11-25 18:00:00 f 1 nt-1 71 nt 72 currDate1 2019-11-25 18:00:00 2019-11-28 18:00:00 sdate 2019-11-28 18:00:00 2019-11-28 18:00:00 12 CAT ['TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.00_Final_completed_wind.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 alldate: DatetimeIndex(['2019-11-26'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112600/all_inpData.txt currDate 2019-11-26 00:00:00 f 2 nt-1 71 nt 72 currDate1 2019-11-26 00:00:00 2019-11-29 00:00:00 sdate 2019-11-29 00:00:00 2019-11-29 00:00:00 13 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_res_stept0.tif. 0.Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_res_stept0.tif. 0....10..10....20..20....30..30....40..40....50..50....60..60....70..70....80..80....90..90.....100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_stept0_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_stept0_clipped.tif. 0.....10..10....20..20....30..30....40..40.....50..50..60....60..70.....7080......8090......90...100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_stept0_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_stept0_clipped.tif. 0......1010......20.20....30..30....40..40....50..50....60..60....70..70....80..80....90..90.....100 - done. 100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml >> 7. remove files done input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_res_all.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_all_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_all_clipped.tif. 0Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml >> 7. remove files done input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.00_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:05:08.547869 UTC Case completed at: 2019-11-26 09:07:37.905527 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:15:10.378797 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:15:10.378797 UTC Case completed at: 2019-11-26 09:15:10.678354 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 09:25:11.548347 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 2 it: 0 ndt: 2 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 2 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 00:00:00 ********** no new data check copy copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 09:25:11.548347 UTC Case completed at: 2019-11-26 09:25:11.737879 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:05:07.448305 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 5 nt 6 currDate1 2019-11-26 06:00:00 2019-11-26 12:00:00 sdate 2019-11-26 12:00:00 2019-11-26 12:00:00 3 CAT ['TD', 'TD', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 71 nt 72 currDate1 2019-11-26 06:00:00 2019-11-29 06:00:00 sdate 2019-11-29 06:00:00 2019-11-29 06:00:00 14 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.06_Final_completed_wind.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112606/all_inpData.txt currDate 2019-11-26 06:00:00 f 3 nt-1 71 nt 72 currDate1 2019-11-26 06:00:00 2019-11-29 06:00:00 sdate 2019-11-29 06:00:00 2019-11-29 06:00:00 14 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.06_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:05:07.448305 UTC Case completed at: 2019-11-26 13:07:11.909152 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:15:06.855195 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:15:06.855195 UTC Case completed at: 2019-11-26 13:15:07.080797 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 13:25:10.273073 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 06:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 3 it: 0 ndt: 3 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 3 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 3 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 13:25:10.273073 UTC Case completed at: 2019-11-26 13:25:10.436241 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:05:11.764720 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 5 nt 6 currDate1 2019-11-26 12:00:00 2019-11-26 18:00:00 sdate 2019-11-26 18:00:00 2019-11-26 18:00:00 4 CAT ['TD', 'TD', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 71 nt 72 currDate1 2019-11-26 12:00:00 2019-11-29 12:00:00 sdate 2019-11-29 12:00:00 2019-11-29 12:00:00 15 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.12_Final_completed_wind.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112612/all_inpData.txt currDate 2019-11-26 12:00:00 f 4 nt-1 71 nt 72 currDate1 2019-11-26 12:00:00 2019-11-29 12:00:00 sdate 2019-11-29 12:00:00 2019-11-29 12:00:00 15 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'H', 'TS', 'TS', 'H', 'TS', 'TS', 'TS', 'H', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.12_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:05:11.764720 UTC Case completed at: 2019-11-26 19:07:22.975230 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:15:05.804302 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:15:05.804302 UTC Case completed at: 2019-11-26 19:15:05.960596 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-26 19:25:15.614269 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 12:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 4 it: 0 ndt: 4 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 4 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 4 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 4 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-26 19:25:15.614269 UTC Case completed at: 2019-11-26 19:25:15.849197 UTC **********E N D O F J O B*********************** Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:05:06.613328 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 5 nt 6 currDate1 2019-11-26 18:00:00 2019-11-27 00:00:00 sdate 2019-11-27 00:00:00 2019-11-27 00:00:00 5 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 71 nt 72 currDate1 2019-11-26 18:00:00 2019-11-29 18:00:00 sdate 2019-11-29 18:00:00 2019-11-29 18:00:00 16 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed itdate, istime 2019-11-26 12:00:00 20191126.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191126.18_Final_completed_wind.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-26 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112618/all_inpData.txt currDate 2019-11-26 18:00:00 f 5 nt-1 71 nt 72 currDate1 2019-11-26 18:00:00 2019-11-29 18:00:00 sdate 2019-11-29 18:00:00 2019-11-29 18:00:00 16 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/20191126.18_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191126.18_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:05:06.613328 UTC Case completed at: 2019-11-27 01:07:05.599785 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:15:06.318987 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:15:06.318987 UTC Case completed at: 2019-11-27 01:15:06.609293 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 01:25:10.904399 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-26 18:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 5 it: 0 ndt: 5 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 5 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 5 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 5 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 5 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-26 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-26 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 01:25:10.904399 UTC Case completed at: 2019-11-27 01:25:11.263453 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 09:55:11.126110 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/ /mnt/input/grib_HWRF/2019/1000636/ Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 598P x 417L. Processing input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif. Using internal nodata values (e.g. -3.40282e+38) for image /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 10:05:07.324691 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 5 nt 6 currDate1 2019-11-27 00:00:00 2019-11-27 06:00:00 sdate 2019-11-27 06:00:00 2019-11-27 06:00:00 6 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.jpg 127.51 157.4 127.51 157.4 0.05 0.05 /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/ /mnt/input/grib_HWRF/2019/1000636/ input file /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 Resample tif file /usr/bin/gdalwarp -r bilinear -te 127.51 5.0 157.4 25.87 -dstnodata 0 "/mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif" outFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif dd: 0.049983277592 >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.534991639 157.375008361 5.05196488294 25.8450083612 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 71 nt 72 currDate1 2019-11-27 00:00:00 2019-11-30 00:00:00 sdate 2019-11-30 00:00:00 2019-11-30 00:00:00 17 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'MH', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.jpg processing all past bull only if Past=True... True itdate, istime 2019-11-25 18:00:00 20191125.18 meteo-processing past forecast already completed itdate, istime 2019-11-26 00:00:00 20191126.00 meteo-processing past forecast already completed itdate, istime 2019-11-26 06:00:00 20191126.06 meteo-processing past forecast already completed itdate, istime 2019-11-26 12:00:00 20191126.12 meteo-processing past forecast already completed itdate, istime 2019-11-26 18:00:00 20191126.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/20191127.00_Final_completed_wind.txt FINAL /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/ date: 2019-11-26 00:00:00 first date 20191126.00 remove maxtif alldate: DatetimeIndex(['2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2019-11-26 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind_stept0.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-26 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-26 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind_stept0.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2019-11-27 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif -B /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif --outfile=/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif stormname 1000636/29w stormname 1000636/29w TCbullsource 29w >> 0. SET INPUT/OUTPUT HWRF /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt 127.559983278 157.4 5.02697324415 25.8200167224 lon 598 lat 417 read TC track /mnt/output/GDACS/TC/TCTrack/1000636/HWRF/2019112700/all_inpData.txt currDate 2019-11-27 00:00:00 f 6 nt-1 71 nt 72 currDate1 2019-11-27 00:00:00 2019-11-30 00:00:00 sdate 2019-11-30 00:00:00 2019-11-30 00:00:00 17 CAT ['TD', 'TD', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'MH', 'TS', 'TS', 'TS', 'TS', 'TS', 'H', 'H', 'MH'] savemap /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00//wind10m_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3587P x 2501L. Processing input file /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3587P x 2501L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191125.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191125.18/20191125.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191125.18/20191125.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.00/20191126.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.00/20191126.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.06/20191126.06_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.06/20191126.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.12/20191126.12_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.12/20191126.12_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191126.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191126.18/20191126.18_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191126.18/20191126.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/20191127.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/20191127.00/20191127.00_wind.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues.xml , /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/20191127.00/20191127.00_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/20191127.00_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (HWRF) OutDir: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final// PopFile: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 127.534991639 5.00334169455 157.426658305 25.8450083612 HWRF /usr/bin/gdalwarp -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te 127.534991639 5.00334169455 157.426658305 25.8450083612 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final//wind10m_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333315 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 10:05:07.324691 UTC Case completed at: 2019-11-27 10:07:31.638459 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2019-11-27 10:15:06.673419 UTC inp1= 20191125.18 ncores= 5 var= wind lw= aa.txt stormname!!!!!!!!!!!!!!!= 1000636/29w submitting calc 2019-11-25 18:00:00 2019-11-27 00:00:00 delft3d 127.51 157.4 5.0 25.87 4.0 HWRF 72 15 True GDACS/1000636/2_HWRF 6 1 False False 5 aa.txt 20191125.18 1000636/29w 6 wind False *************---------------------****************** GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_6h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_6h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_6h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_6h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_6h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_6h.tif input file exist GDACS/1000636/2_HWRF 1000636 ndt: 6 it: 0 ndt: 6 idate: 2019-11-25 18:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112518.swath.wind_72h.tif input file exist it: 1 ndt: 6 idate: 2019-11-26 00:00:00 /mnt/input/grib_HWRF/2019/1000636/twenty-ni29w.2019112600.swath.wind_72h.tif input file exist it: 2 ndt: 6 idate: 2019-11-26 06:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112606.swath.wind_72h.tif input file exist it: 3 ndt: 6 idate: 2019-11-26 12:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112612.swath.wind_72h.tif input file exist it: 4 ndt: 6 idate: 2019-11-26 18:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112618.swath.wind_72h.tif input file exist it: 5 ndt: 6 idate: 2019-11-27 00:00:00 /mnt/input/grib_HWRF/2019/1000636/kammuri29w.2019112700.swath.wind_72h.tif input file exist home dir /mnt/output/SSCS/2019/GDACS/1000636/2_HWRF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2019-11-25 18:00:00 currdate 2019-11-27 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2019-11-25 18:00:00', '2019-11-26 00:00:00', '2019-11-26 06:00:00', '2019-11-26 12:00:00', '2019-11-26 18:00:00', '2019-11-27 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 127.51 157.4 5.0 25.87 processing curr bull... 2019-11-27 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2019-11-27 10:15:06.673419 UTC Case completed at: 2019-11-27 10:15:07.174985 UTC **********E N D O F J O B***********************