******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-13 22:55:09.206315 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-13 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-13 22:55:10.255398 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-13 23:05:07.324707 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-13 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-13 23:15:07.399450 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-13 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/13/20201113.00.precip.grib ('lon0<0', -95.99) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.00_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False it: 1 ndt: 2 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-13 23:16:57.464464 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-13 23:25:10.262967 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-13 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-13 23:35:08.052522 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-13 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/13/20201113.12.precip.grib ('lon0<0', -95.99) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201113.12_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= True forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-13 12:00:00 ndt: 12 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-13 12:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 546.905517578 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111312/all_inpData.txt error track file-->map without track trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-11-13 00:00:00 20201113.00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 395.141601562 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111300/all_inpData.txt error track file-->map without track trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/20201113.12_Final_completed_rain.txt FINAL alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 2 date: 2020-11-13 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111312/all_inpData.txt error track file-->map without track trackfile 0 -95.9413332682 -65.9113332682 5.35173062228 23.9017306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_res_stept0.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_res_stept0.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_stept0_clipped.tif. 0.Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_stept0_clipped.tif. 0....10..10....20..20.....3030.....40..40....50..50....60..60....70.70......8080......9090......100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_stept0_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_res_all.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_res_all.tif. 0......1010......2020.....30..30....40..40....50..50....60..60....70..70....80..80....90..90.....100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_all_clipped.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_all_clipped.tif. 0..Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_all_clipped.tif. 0.10......1020......3020......4030......5040......6050......7060......8070......9080......90...100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201113.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-11-13 22:55:09.206315 UTC Case completed at: 2020-11-13 23:38:40.502755 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 08:25:10.117019 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 08:25:13.233247 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.00.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 08:35:05.195480 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 08:35:08.249977 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.00.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 08:45:05.793522 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 08:45:08.844220 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.00.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 08:55:09.336686 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 08:55:12.410891 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.00.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 09:05:06.261585 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 09:05:09.348730 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 09:15:06.283782 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.00.precip.grib ('lon0<0', -95.99) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.00_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-14 00:00:00 ndt: 24 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-14 00:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 405.242919922 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111400/all_inpData.txt trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-11-13 00:00:00 20201113.00 meteo-processing past forecast already completed itdate, istime 2020-11-13 12:00:00 20201113.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/20201114.00_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 3 date: 2020-11-13 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-14 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111400/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111400/all_inpData.txt trackfile 0 -95.9413332682 -65.9113332682 5.35173062228 23.9017306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201114.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-11-14 09:05:06.261585 UTC Case completed at: 2020-11-14 09:24:56.307251 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 09:25:09.896787 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-14 00:00:00 ndt: 24 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-14 00:00:00 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast t0 completed t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201114.00_final_completed_rain.txt copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/final/rain.jpg ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 20:15:05.775086 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 20:15:09.886486 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.12.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.12.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 20:25:09.626891 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 20:25:13.704650 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.12.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.12.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 20:35:05.898247 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 20:35:09.958899 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.12.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.12.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 20:45:06.093582 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 20:45:10.153313 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.12.precip.grib ...no data in /mnt/input/grib/2020/11/14/20201114.12.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 20:55:09.738681 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-14 20:55:14.070796 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:05:07.845650 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:15:12.161271 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:25:12.499169 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:35:08.153393 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:45:08.361259 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 21:55:11.387597 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 22:05:07.922188 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc ...opening grib file /mnt/input/grib/2020/11/14/20201114.12.precip.grib ('lon0<0', -95.99) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201114.12_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-14 12:00:00 ndt: 36 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-14 12:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 409.057617188 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-11-13 00:00:00 20201113.00 meteo-processing past forecast already completed itdate, istime 2020-11-13 12:00:00 20201113.12 meteo-processing past forecast already completed itdate, istime 2020-11-14 00:00:00 20201114.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/20201114.12_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 4 date: 2020-11-13 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-14 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-14 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt trackfile 0 -95.9413332682 -65.9113332682 5.35173062228 23.9017306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-14 22:15:16.905987 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-14 12:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours ...100 - done. Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-14 12:00:00 ndt: 36 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-14 12:00:00 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast t0 completed Creating output file that is 3612P x 2234L. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 Creating output file that is 3612P x 2234L. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201114.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201114.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 08:15:05.146680 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-15 08:15:10.226906 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/15/20201115.00.precip.grib ...no data in /mnt/input/grib/2020/11/15/20201115.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 08:25:09.115677 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-15 08:25:14.206413 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/15/20201115.00.precip.grib ...no data in /mnt/input/grib/2020/11/15/20201115.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 08:35:05.271314 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-15 08:35:10.383028 ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/15/20201115.00.precip.grib ...no data in /mnt/input/grib/2020/11/15/20201115.00.precip.grib ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 08:45:06.324720 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-11-15 08:45:11.440906 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 08:55:09.944286 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 09:05:07.515773 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 09:15:12.138331 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc ...opening grib file /mnt/input/grib/2020/11/15/20201115.00.precip.grib ('lon0<0', -95.99) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/netcdf/20201115.00_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-15 00:00:00 ndt: 48 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00', '2020-11-15 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-15 00:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 442.932128906 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111500/all_inpData.txt trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-11-13 00:00:00 20201113.00 meteo-processing past forecast already completed itdate, istime 2020-11-13 12:00:00 20201113.12 meteo-processing past forecast already completed itdate, istime 2020-11-14 00:00:00 20201114.00 meteo-processing past forecast already completed itdate, istime 2020-11-14 12:00:00 20201114.12 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 266 430 73 nt,nx,ny, ntmax 72 266 430 73 GeoT [-95.976333268225119, 0.07, 0, 23.936730622281004, 0, -0.07] create json 409.057617188 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111412/all_inpData.txt trackfile 0 -95.9763332682 -65.812244579 5.30755701627 23.9367306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/20201115.00_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00', '2020-11-15 00:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 5 date: 2020-11-13 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-14 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-14 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-11-15 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111500/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000743/ECMWF/2020111500/all_inpData.txt trackfile 0 -95.9413332682 -65.9113332682 5.35173062228 23.9017306223 lon 430 lat 266 savemap /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_res_all.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_res_all.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif. 0Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_all_clipped.tif. 0......1010......2020......3030......4040......5050......6060......7070......8080......9090......100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3612P x 2234L. Processing input file /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3612P x 2234L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-11-15 09:25:12.956088 UTC inp1= 20201113.00 ncores= 2 var= rain submitting calc 2020-11-13 00:00:00 2020-11-15 00:00:00 delft3d -95.99 -65.75 5.3 24.0 4.0 ECMWF 72 15 True GDACS/1000743/2_ECMWF 6 1 False False 2 20201113.00 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-11-13 00:00:00 running case from 2020-11-13 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20201113.00 RUNNING 2020-11-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-11-13 12:00:00 running case from 2020-11-13 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201113.12 RUNNING 2020-11-13 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-11-14 00:00:00 running case from 2020-11-14 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.00 RUNNING 2020-11-14 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-11-14 12:00:00 running case from 2020-11-14 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20201114.12 RUNNING 2020-11-14 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-11-15 00:00:00 running case from 2020-11-15 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20201115.00 RUNNING 2020-11-15 00:00:00 for 72 hours Creating output file that is 3612P x 2234L. Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-11-13 00:00:00 currdate 2020-11-15 00:00:00 ndt: 48 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-11-13 00:00:00', '2020-11-13 12:00:00', '2020-11-14 00:00:00', '2020-11-14 12:00:00', '2020-11-15 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -95.99 -65.75 5.3 24.0 processing curr bull... 2020-11-15 00:00:00 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast t0 completed t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/20201114.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/20201115.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201115.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.00/20201113.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.00/20201113.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201113.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201113.12/20201113.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201113.12/20201113.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.00/20201114.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.00/20201114.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201114.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201114.12/20201114.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201114.12/20201114.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/20201115.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/20201115.00/20201115.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/delft3d/20201115.00/20201115.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/20201115.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 ECMWF /usr/bin/gdalwarp -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -95.9763332682 5.32006395562 -65.8763332682 23.9367306223 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000743/2_ECMWF/class/final/rain_popDensValues_final.xml >> 7. remove files