******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:25:10.674197 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-02 22:25:11.694533 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/02/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 93 123 73 nt,nx,ny, ntmax 72 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 719.125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040218/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg processing all past bull only if Past=True... False no past >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200402.18_Final_completed_rain.txt FINAL **FIRST alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040218/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//rain_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200402.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-02 22:25:10.674197 UTC Case completed at: 2020-04-02 22:28:20.850901 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:35:05.767529 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 ********** no new data check copy copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:45:04.964075 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var rain **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 ********** no new data check copy copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:25:11.026885 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 08:25:13.066347 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 63/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 93 123 73 nt,nx,ny, ntmax 72 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 806.0625 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt 151.5 182.0 -28.0 -5.0 lon 123 lat 93 read TC track /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt currDate 2020-04-03 00:00:00 f 2 nt-1 72 nt 73 currDate1 2020-04-03 00:00:00 2020-04-06 01:00:00 sdate 2020-04-06 01:00:00 -2 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.00_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt 151.625 182.125 -28.125 -5.125 lon 123 lat 93 read TC track /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt currDate 2020-04-03 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-04-03 00:00:00 2020-04-06 00:00:00 sdate 2020-04-06 00:00:00 2020-04-06 00:00:00 13 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//rain_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.00_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 08:25:11.026885 UTC Case completed at: 2020-04-03 08:28:26.416147 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:35:05.846914 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:45:06.517292 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:55:09.585898 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:05:04.849264 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 12:05:07.932462 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 63/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 93 123 73 nt,nx,ny, ntmax 72 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 707.5625 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040306/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.06_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040306/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//rain_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.06_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 12:05:04.849264 UTC Case completed at: 2020-04-03 12:08:25.027784 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:15:05.655172 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:25:18.674598 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:05:05.287198 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 18:05:09.384853 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 63/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 93 123 73 nt,nx,ny, ntmax 72 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 816.3125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040312/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed itdate, istime 2020-04-03 06:00:00 20200403.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.12_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040312/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//rain_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/20200403.12_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.12_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 18:05:05.287198 UTC Case completed at: 2020-04-03 18:08:25.563012 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:15:07.315981 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:25:10.311640 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:05:05.009440 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-04 00:05:10.131123 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/100060 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 63/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18_rain.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 forcing GFS verifying that input file is present start reading nc... rain use all data in nc file nt,nx,ny, ntmax 72 93 123 73 nt,nx,ny, ntmax 72 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 763.3125 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040318/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed itdate, istime 2020-04-03 06:00:00 20200403.06 meteo-processing past forecast already completed itdate, istime 2020-04-03 12:00:00 20200403.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.18_Final_completed_rain.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" date: 2020-04-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif --calc="(A+B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040318/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain_stept0.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_stept0.xml outDir created popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//rain_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/20200403.12_copy_completed_rain.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/rain_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_rain.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/rain_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/20200403.18_copy_completed_rain.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.18_final_completed_rain.txt input var: rain Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_final.tif hurName: hdate: var: rain description: rain: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//rain_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/rain_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/rain_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/rain.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-04 00:05:05.009440 UTC Case completed at: 2020-04-04 00:08:16.958542 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:15:05.025279 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:25:13.574216 UTC inp1= 20200402.18 ncores= 2 var= rain submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 2 20200402.18 6 rain True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var rain **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var rain **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var rain **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ==============================================================