******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:05:05.431679 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:05:06.452554 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:15:06.027211 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:15:07.127770 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:25:11.966889 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:25:13.064251 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:35:06.083634 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:35:07.147131 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:45:05.933951 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:45:06.972030 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 21:55:09.495376 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 21:55:10.518975 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 file does not exist: /mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 ..exiting ret= -4 removing submitted ret= -4 newcase= False forceFinal= False forceBulletin= False meteo file not yet available home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -4 no impact estimation ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 22:05:05.448648 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-30 22:05:06.487072 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/30/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/05/30/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200530.18_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-30 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-30 18:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 632.3125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053018/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg processing all past bull only if Past=True... False no past >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200530.18_Final_completed_rain.txt FINAL **FIRST alldate: DatetimeIndex(['2020-05-30 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.tif /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053018/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200530.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-05-30 22:05:05.448648 UTC Case completed at: 2020-05-30 22:06:48.499074 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-30 22:15:05.195165 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-30 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-30 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-30 18:00:00 ********** no new data check copy copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 06:05:05.420589 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 00:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-31 06:05:07.477293 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/31/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t00z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.00_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 00:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 442.8125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053100/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200531.00_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053100/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200531.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-05-31 06:05:05.420589 UTC Case completed at: 2020-05-31 06:06:53.408229 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 06:15:05.498683 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 00:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 12:05:05.894216 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 06:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-31 12:05:08.967921 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/31/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t06z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.06_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 06:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 456.375 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053106/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200531.06_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053106/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200531.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-05-31 12:05:05.894216 UTC Case completed at: 2020-05-31 12:06:58.653505 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 12:15:05.046467 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 06:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 18:05:05.092029 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 12:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-05-31 18:05:09.150452 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/31/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t12z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.12_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 12:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 541.8125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053112/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed itdate, istime 2020-05-31 06:00:00 20200531.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200531.12_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053112/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/20200531.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200531.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-05-31 18:05:05.092029 UTC Case completed at: 2020-05-31 18:06:56.849322 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-05-31 18:15:05.768721 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 12:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 00:05:05.007600 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-06-01 00:05:10.099357 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/05/31/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/05/31/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200531.18_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 18:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 466.625 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053118/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed itdate, istime 2020-05-31 06:00:00 20200531.06 meteo-processing past forecast already completed itdate, istime 2020-05-31 12:00:00 20200531.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200531.18_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020053118/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/20200531.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/20200531.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200531.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-01 00:05:05.007600 UTC Case completed at: 2020-06-01 00:06:58.134238 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 00:15:05.459443 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-05-31 18:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-05-31 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-05-31 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 06:05:06.121320 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 00:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 6 it: 0 ndt: 6 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 6 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 6 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 6 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 6 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 6 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-06-01 06:05:12.209864 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/06/01/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t00z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.00_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 00:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 415.5 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060100/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed itdate, istime 2020-05-31 06:00:00 20200531.06 meteo-processing past forecast already completed itdate, istime 2020-05-31 12:00:00 20200531.12 meteo-processing past forecast already completed itdate, istime 2020-05-31 18:00:00 20200531.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200601.00_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 6 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060100/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/20200531.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/20200531.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/20200601.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200601.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-01 06:05:06.121320 UTC Case completed at: 2020-06-01 06:07:04.329146 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 06:15:05.419928 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 00:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 6 it: 0 ndt: 6 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 6 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 6 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 6 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 6 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 6 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 00:00:00 ndt: 30 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 00:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 12:05:06.030142 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 06:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 7 it: 0 ndt: 7 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 7 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 7 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 7 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 7 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 7 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 6 ndt: 7 idate: 2020-06-01 06:00:00 running case from 2020-06-01 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.06 RUNNING 2020-06-01 06:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-06-01 12:05:13.148894 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/06/01/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t06z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.06_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 06:00:00 ndt: 36 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 06:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 521.25 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060106/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed itdate, istime 2020-05-31 06:00:00 20200531.06 meteo-processing past forecast already completed itdate, istime 2020-05-31 12:00:00 20200531.12 meteo-processing past forecast already completed itdate, istime 2020-05-31 18:00:00 20200531.18 meteo-processing past forecast already completed itdate, istime 2020-06-01 00:00:00 20200601.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200601.06_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 7 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060106/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/20200531.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/20200531.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/20200601.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/20200601.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200601.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-01 12:05:06.030142 UTC Case completed at: 2020-06-01 12:07:09.084636 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 12:15:05.002249 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 06:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 7 it: 0 ndt: 7 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 7 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 7 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 7 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 7 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 7 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 6 ndt: 7 idate: 2020-06-01 06:00:00 running case from 2020-06-01 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.06 RUNNING 2020-06-01 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 06:00:00 ndt: 36 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 06:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 18:05:06.154445 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 12:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 8 it: 0 ndt: 8 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 8 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 8 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 8 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 8 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 8 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 6 ndt: 8 idate: 2020-06-01 06:00:00 running case from 2020-06-01 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.06 RUNNING 2020-06-01 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 7 ndt: 8 idate: 2020-06-01 12:00:00 running case from 2020-06-01 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.12 RUNNING 2020-06-01 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-06-01 18:05:14.248577 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/06/01/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 0 .. 50 .. 100 - Done 71/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/06/01/gfs.t12z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/netcdf/20200601.12_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 12:00:00 ndt: 42 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00', '2020-06-01 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 12:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 56 56 73 nt,nx,ny, ntmax 72 56 56 73 GeoT [-98.0, 0.25, 0, 19.0, 0, -0.25] create json 683.0625 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060112/all_inpData.txt error track file-->map without track trackfile 0 -98.0 -84.25 5.25 19.0 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-05-30 18:00:00 20200530.18 meteo-processing past forecast already completed itdate, istime 2020-05-31 00:00:00 20200531.00 meteo-processing past forecast already completed itdate, istime 2020-05-31 06:00:00 20200531.06 meteo-processing past forecast already completed itdate, istime 2020-05-31 12:00:00 20200531.12 meteo-processing past forecast already completed itdate, istime 2020-05-31 18:00:00 20200531.18 meteo-processing past forecast already completed itdate, istime 2020-06-01 00:00:00 20200601.00 meteo-processing past forecast already completed itdate, istime 2020-06-01 06:00:00 20200601.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/20200601.12_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00', '2020-06-01 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 8 date: 2020-05-31 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-05-31 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-06-01 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000671/AVNO/2020060112/all_inpData.txt error track file-->map without track trackfile 0 -97.875 -84.125 5.125 18.875 lon 56 lat 56 savemap /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_stept0_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_stept0_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_stept0_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_all_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_popfile_all_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12//rain_countryfile_all_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 1680P x 1680L. Processing input file /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 1680P x 1680L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200530.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200530.18/20200530.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200530.18/20200530.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.00/20200531.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.00/20200531.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.06/20200531.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.06/20200531.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.12/20200531.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.12/20200531.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200531.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200531.18/20200531.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200531.18/20200531.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.00/20200601.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.00/20200601.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.06/20200601.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.06/20200601.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/20200601.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/20200601.12/20200601.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/20200601.12/20200601.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/20200601.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift False -1 -98.0 5.00000000001 -84.0 19.0 GFS /usr/bin/gdalwarp -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/lspop20141.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_popfile_final_clipped.tif" >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density gdalwarp -r near -tr 0.00833333333333 0.00833333333333 -te -98.0 5.00000000001 -84.0 19.0 "/mnt/output/GDACS/DATA/countries.tif" "/mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final//rain_countryfile_final_clipped.tif" >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-06-01 18:05:06.154445 UTC Case completed at: 2020-06-01 18:07:04.272158 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-06-01 18:15:05.117438 UTC inp1= 20200530.18 ncores= 2 var= rain submitting calc 2020-05-30 18:00:00 2020-06-01 12:00:00 delft3d -98.1 -84.08 5.05 19.05 4.0 GFS 72 15 True GDACS/1000671/1_GFS 6 1 False False 2 20200530.18 6 rain False *************---------------------****************** stormname ndt: 8 it: 0 ndt: 8 idate: 2020-05-30 18:00:00 running case from 2020-05-30 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200530.18 RUNNING 2020-05-30 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 8 idate: 2020-05-31 00:00:00 running case from 2020-05-31 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.00 RUNNING 2020-05-31 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 8 idate: 2020-05-31 06:00:00 running case from 2020-05-31 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.06 RUNNING 2020-05-31 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 8 idate: 2020-05-31 12:00:00 running case from 2020-05-31 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.12 RUNNING 2020-05-31 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 8 idate: 2020-05-31 18:00:00 running case from 2020-05-31 18:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200531.18 RUNNING 2020-05-31 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 5 ndt: 8 idate: 2020-06-01 00:00:00 running case from 2020-06-01 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.00 RUNNING 2020-06-01 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 6 ndt: 8 idate: 2020-06-01 06:00:00 running case from 2020-06-01 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200601.06 RUNNING 2020-06-01 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 7 ndt: 8 idate: 2020-06-01 12:00:00 running case from 2020-06-01 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200601.12 RUNNING 2020-06-01 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000671/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-05-30 18:00:00 currdate 2020-06-01 12:00:00 ndt: 42 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-05-30 18:00:00', '2020-05-31 00:00:00', '2020-05-31 06:00:00', '2020-05-31 12:00:00', '2020-05-31 18:00:00', '2020-06-01 00:00:00', '2020-06-01 06:00:00', '2020-06-01 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 -98.1 -84.08 5.05 19.05 processing curr bull... 2020-06-01 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok copy ok copy ok copy ok no new data ==============================================================