******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 09:45:07.763880 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-09-13 09:45:08.799334 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 09:55:09.074211 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc ...opening grib file /mnt/input/grib/2020/09/12/20200912.00.precip.grib ('lon0<0', -67.62) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.00_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-09-13 10:03:32.009284 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 10:05:04.960142 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 10:15:06.312382 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc ...opening grib file /mnt/input/grib/2020/09/12/20200912.12.precip.grib ('lon0<0', -67.62) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200912.12_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= True forceFinal= False forceBulletin= False it: 2 ndt: 3 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-09-13 10:22:44.660451 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 10:25:10.051086 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 10:35:04.617059 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc ...opening grib file /mnt/input/grib/2020/09/13/20200913.00.precip.grib ('lon0<0', -67.62) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.00_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= True forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-09-12 00:00:00 currdate 2020-09-13 00:00:00 ndt: 24 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -67.62 -22.33 5.0 25.99 processing curr bull... 2020-09-13 00:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 299 644 73 nt,nx,ny, ntmax 72 299 644 73 GeoT [-67.570058605195356, 0.07, 0, 25.975394898359827, 0, -0.07] create json 597.183227539 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091300/all_inpData.txt error track file-->map without track trackfile 0 -67.5700586052 -22.3590818519 5.02636194258 25.9753948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-09-12 00:00:00 20200912.00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 299 644 73 nt,nx,ny, ntmax 72 299 644 73 GeoT [-67.570058605195356, 0.07, 0, 25.975394898359827, 0, -0.07] create json 292.541503906 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091200/all_inpData.txt error track file-->map without track trackfile 0 -67.5700586052 -22.3590818519 5.02636194258 25.9753948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.jpg itdate, istime 2020-09-12 12:00:00 20200912.12 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 299 644 73 nt,nx,ny, ntmax 72 299 644 73 GeoT [-67.570058605195356, 0.07, 0, 25.975394898359827, 0, -0.07] create json 631.500244141 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091212/all_inpData.txt error track file-->map without track trackfile 0 -67.5700586052 -22.3590818519 5.02636194258 25.9753948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.jpg >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/20200913.00_Final_completed_rain.txt FINAL alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 3 date: 2020-09-12 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-09-13 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091300/all_inpData.txt error track file-->map without track trackfile 0 -67.5350586052 -22.5250586052 5.08039489836 25.9403948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_res_stept0.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_res_stept0.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_res_stept0.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070........80.80.80.....90....90.90.......100 - done. 100 - done. 100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_stept0_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_stept0_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_stept0_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_stept0_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_stept0_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_stept0.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_stept0.xml >> 7. remove files done lim core t0 completed Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_res_all.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_res_all.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_res_all.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_all_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_all_clipped.tif. 0.....Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_all_clipped.tif. 0.10.10.......10.20.20.......20.30.30.......30.40.40.....40....50.50.50........60.60..60......7070..70.......8080...80......9090...90.......100 - done. 100 - done. 100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_all_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_all_clipped.tif. 0Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_all_clipped.tif. 0.........101010.........202020.........303030.........404040.........505050.........606060.........707070.........808080.........909090.........100 - done. 100 - done. 100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_all.xml >> 7. remove files done input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. lim core t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/20200912.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/20200912.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/20200913.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/20200913.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-09-13 09:45:07.763880 UTC Case completed at: 2020-09-13 10:44:38.713505 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 10:45:05.365923 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 00:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-09-12 00:00:00 currdate 2020-09-13 00:00:00 ndt: 24 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -67.62 -22.33 5.0 25.99 processing curr bull... 2020-09-13 00:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 22:55:08.997420 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-09-13 22:55:13.153360 ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 23:05:06.956112 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 23:15:08.287096 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 23:25:12.871834 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 23:35:06.374121 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours Calculation already submitted (file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/submittedrain.txt ) **exiting** ret= -1 newcase= False forceFinal= False forceBulletin= False another job is running, thus I stop here 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done 0 .. 10 .. 20 .. 30 .. 40 .. 50 .. 60 .. 70 .. 80 .. 90 .. 100 - Done ..1.1 calling ECMWF_2_netcdf... ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc ...opening grib file /mnt/input/grib/2020/09/13/20200913.12.precip.grib ('lon0<0', -67.62) shiftGrid=True ...nt= 72 ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/netcdf/20200913.12_rain.nc.tmp ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-09-12 00:00:00 currdate 2020-09-13 12:00:00 ndt: 36 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00', '2020-09-13 12:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -67.62 -22.33 5.0 25.99 processing curr bull... 2020-09-13 12:00:00 forcing ECMWF verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 299 644 73 nt,nx,ny, ntmax 72 299 644 73 GeoT [-67.570058605195356, 0.07, 0, 25.975394898359827, 0, -0.07] create json 419.616699219 forcing ECMWF >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091312/all_inpData.txt error track file-->map without track trackfile 0 -67.5700586052 -22.3590818519 5.02636194258 25.9753948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-09-12 00:00:00 20200912.00 meteo-processing past forecast already completed itdate, istime 2020-09-12 12:00:00 20200912.12 meteo-processing past forecast already completed itdate, istime 2020-09-13 00:00:00 20200913.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/20200913.12_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00', '2020-09-13 12:00:00'], dtype='datetime64[ns]', freq='12H') alldate.shape 4 date: 2020-09-12 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-09-13 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif --calc="(A+B)" date: 2020-09-13 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT ECMWF /mnt/output/GDACS/TC/TCTrack/1000714/ECMWF/2020091312/all_inpData.txt error track file-->map without track trackfile 0 -67.5350586052 -22.5250586052 5.08039489836 25.9403948984 lon 644 lat 299 savemap /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 5410P x 2512L. Processing input file /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 5410P x 2512L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.00/20200912.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.00/20200912.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200912.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200912.12/20200912.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200912.12/20200912.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.00/20200913.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.00/20200913.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/20200913.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/20200913.12/20200913.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/20200913.12/20200913.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/20200913.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (ECMWF) OutDir: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 ECMWF /usr/bin/gdalwarp -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -67.5700586052 5.04206156503 -22.4867252719 25.9753948984 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-09-13 22:55:08.997420 UTC Case completed at: 2020-09-13 23:44:46.426866 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-09-13 23:45:05.574898 UTC inp1= 20200912.00 ncores= 2 var= rain submitting calc 2020-09-12 00:00:00 2020-09-13 12:00:00 delft3d -67.62 -22.33 5.0 25.99 4.0 ECMWF 72 15 True GDACS/1000714/3_ECMWF 6 1 False False 2 20200912.00 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-09-12 00:00:00 running case from 2020-09-12 00:00:00 for 12 h start= 1 var rain **** gometeo: 12 listWindows rundate:20200912.00 RUNNING 2020-09-12 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-09-12 12:00:00 running case from 2020-09-12 12:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200912.12 RUNNING 2020-09-12 12:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-09-13 00:00:00 running case from 2020-09-13 00:00:00 for 12 h start= 0 var rain **** gometeo: 12 listWindows rundate:20200913.00 RUNNING 2020-09-13 00:00:00 for 12 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-09-13 12:00:00 running case from 2020-09-13 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200913.12 RUNNING 2020-09-13 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000714/3_ECMWF/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-09-12 00:00:00 currdate 2020-09-13 12:00:00 ndt: 36 delta: 12 nt1=delta 12 nt 72 alldate: DatetimeIndex(['2020-09-12 00:00:00', '2020-09-12 12:00:00', '2020-09-13 00:00:00', '2020-09-13 12:00:00'], dtype='datetime64[ns]', freq='12H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -67.62 -22.33 5.0 25.99 processing curr bull... 2020-09-13 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ==============================================================