******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:25:10.673840 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var wind **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours creating /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-02 22:25:10.701046 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/02/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc STEP: 0 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f000.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 0 STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/02/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200402.18.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 forcing GFS verifying that input file is present wind start reading nc... wind use all data in nc file ...create velAll ...start calculating velAll ...end calculating velAll nt,nx,ny, ntmax 73 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 37.3603543982 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040218/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg processing all past bull only if Past=True... False no past >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200402.18_Final_completed_wind.txt FINAL **FIRST alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 1 **FIRST cp /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040218/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18//wind10m_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200402.18_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-02 22:25:10.673840 UTC Case completed at: 2020-04-02 22:28:46.465814 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:35:05.767317 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var wind **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 ********** no new data check copy copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-02 22:45:04.964122 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-02 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 1 it: 0 ndt: 1 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 72 h start= 1 var wind **** gometeo: 72 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-02 18:00:00 ndt: 0 delta: 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-02 18:00:00 ********** no new data check copy copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:25:11.026653 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 08:25:11.175796 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc STEP: 0 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f000.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 0 STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t00z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.00.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 forcing GFS verifying that input file is present wind start reading nc... wind use all data in nc file ...create velAll ...start calculating velAll ...end calculating velAll nt,nx,ny, ntmax 73 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 38.7538529559 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt 151.5 182.0 -28.0 -5.0 lon 123 lat 93 read TC track /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt currDate 2020-04-03 00:00:00 f 2 nt-1 72 nt 73 currDate1 2020-04-03 00:00:00 2020-04-06 01:00:00 sdate 2020-04-06 01:00:00 -2 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TD', 'TS', 'TD', 'TD'] savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.00_Final_completed_wind.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 2 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040300/all_inpData.txt /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt trackfile /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt 151.625 182.125 -28.125 -5.125 lon 123 lat 93 read TC track /mnt/output/GDACS/TC/TCTrack/1000663/AEMN/2020040300/all_inpData.txt currDate 2020-04-03 00:00:00 f 2 nt-1 71 nt 72 currDate1 2020-04-03 00:00:00 2020-04-06 00:00:00 sdate 2020-04-06 00:00:00 2020-04-06 00:00:00 13 CAT ['TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS', 'TS'] savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00//wind10m_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.00_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 08:25:11.026653 UTC Case completed at: 2020-04-03 08:29:01.598940 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:35:05.846498 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:45:06.517532 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 08:55:09.585682 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 00:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 2 it: 0 ndt: 2 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 2 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 00:00:00 ndt: 6 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 00:00:00 ********** no new data check copy copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:05:04.849644 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 12:05:04.970716 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc STEP: 0 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f000.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 0 STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t06z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.06.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 forcing GFS verifying that input file is present wind start reading nc... wind use all data in nc file ...create velAll ...start calculating velAll ...end calculating velAll nt,nx,ny, ntmax 73 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 37.4022763851 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040306/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.06_Final_completed_wind.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 3 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040306/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06//wind10m_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.06_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 12:05:04.849644 UTC Case completed at: 2020-04-03 12:08:41.015108 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:15:05.658367 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 12:25:18.674832 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 06:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 3 it: 0 ndt: 3 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 3 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 3 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 06:00:00 ndt: 12 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 06:00:00 ********** no new data check copy copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:05:05.219027 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-03 18:05:05.350999 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc STEP: 0 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f000.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 0 STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t12z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.12.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 forcing GFS verifying that input file is present wind start reading nc... wind use all data in nc file ...create velAll ...start calculating velAll ...end calculating velAll nt,nx,ny, ntmax 73 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 40.3422639478 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040312/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed itdate, istime 2020-04-03 06:00:00 20200403.06 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.12_Final_completed_wind.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 4 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040312/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12//wind10m_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/20200403.12_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.12_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-03 18:05:05.219027 UTC Case completed at: 2020-04-03 18:08:45.685064 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:15:07.315831 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-03 18:25:10.221968 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 12:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 4 it: 0 ndt: 4 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 4 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 4 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 4 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 12:00:00 ndt: 18 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 12:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:05:05.008852 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours ============================================ process meteo ============================================ 1. process meteo, starting at 2020-04-04 00:05:05.126944 ..1.1 calling GFS_2_netcdf... inputDir: /mnt/input/grib_GFS/2020/04/03/ output netcdf dir:/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/ output netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc verifying that all files are present. Tot files required: 73 ...ready to create the netcdf file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc STEP: 0 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f000.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...creating nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp open netCDF file: ....writing lat, lon createnc ok ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 0 STEP: 1 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f001.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 1 STEP: 2 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f002.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 2 STEP: 3 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f003.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 3 STEP: 4 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f004.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 4 STEP: 5 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f005.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 5 STEP: 6 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f006.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 6 STEP: 7 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f007.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 7 STEP: 8 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f008.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 8 STEP: 9 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f009.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 9 STEP: 10 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f010.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 10 STEP: 11 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f011.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 11 STEP: 12 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f012.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 12 STEP: 13 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f013.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 13 STEP: 14 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f014.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 14 STEP: 15 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f015.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 15 STEP: 16 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f016.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 16 STEP: 17 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f017.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 17 STEP: 18 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f018.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 18 STEP: 19 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f019.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 19 STEP: 20 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f020.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 20 STEP: 21 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f021.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 21 STEP: 22 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f022.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 22 STEP: 23 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f023.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 23 STEP: 24 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f024.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 24 STEP: 25 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f025.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 25 STEP: 26 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f026.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 26 STEP: 27 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f027.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 27 STEP: 28 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f028.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 28 STEP: 29 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f029.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 29 STEP: 30 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f030.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 30 STEP: 31 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f031.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 31 STEP: 32 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f032.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 32 STEP: 33 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f033.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 33 STEP: 34 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f034.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 34 STEP: 35 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f035.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 35 STEP: 36 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f036.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 36 STEP: 37 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f037.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 37 STEP: 38 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f038.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 38 STEP: 39 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f039.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 39 STEP: 40 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f040.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 40 STEP: 41 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f041.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 41 STEP: 42 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f042.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 42 STEP: 43 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f043.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 43 STEP: 44 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f044.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 44 STEP: 45 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f045.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 45 STEP: 46 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f046.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 46 STEP: 47 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f047.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 47 STEP: 48 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f048.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 48 STEP: 49 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f049.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 49 STEP: 50 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f050.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 50 STEP: 51 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f051.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 51 STEP: 52 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f052.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 52 STEP: 53 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f053.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 53 STEP: 54 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f054.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 54 STEP: 55 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f055.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 55 STEP: 56 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f056.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 0 .. 10 .. 30 .. 50 .. 60 .. 80 .. 100 - Done 1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 56 STEP: 57 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f057.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 57 STEP: 58 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f058.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 58 STEP: 59 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f059.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 59 STEP: 60 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f060.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 60 STEP: 61 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f061.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 61 STEP: 62 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f062.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 62 STEP: 63 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f063.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 63 STEP: 64 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f064.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 64 STEP: 65 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f065.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 65 STEP: 66 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f066.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 66 STEP: 67 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f067.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 67 STEP: 68 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f068.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 68 STEP: 69 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f069.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 69 STEP: 70 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f070.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 70 STEP: 71 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f071.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 71 STEP: 72 ..... Open grib file/mnt/input/grib_GFS/2020/04/03/gfs.t18z.pgrb2.0p25.f072.grb2 netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ...appending nc file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc.tmp .... END STEP: 72 FINAL netCDF file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/netcdf/20200403.18.nc ret= 0 removing submitted ret= 0 newcase= False forceFinal= False forceBulletin= False home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret 0 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 forcing GFS verifying that input file is present wind start reading nc... wind use all data in nc file ...create velAll ...start calculating velAll ...end calculating velAll nt,nx,ny, ntmax 73 93 123 73 GeoT [151.5, 0.25, 0, -5.0, 0, -0.25] create json 41.7398326232 forcing GFS >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040318/all_inpData.txt error track file-->map without track trackfile 0 151.5 182.0 -28.0 -5.0 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.jpg processing all past bull only if Past=True... True itdate, istime 2020-04-02 18:00:00 20200402.18 meteo-processing past forecast already completed itdate, istime 2020-04-03 00:00:00 20200403.00 meteo-processing past forecast already completed itdate, istime 2020-04-03 06:00:00 20200403.06 meteo-processing past forecast already completed itdate, istime 2020-04-03 12:00:00 20200403.12 meteo-processing past forecast already completed >> 2.2. Process final data files compfile /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/20200403.18_Final_completed_wind.txt FINAL remove maxtif alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') alldate.shape 5 date: 2020-04-03 00:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind_stept0.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 06:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 12:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind_stept0.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" date: 2020-04-03 18:00:00 python /usr/bin/gdal_calc.py -A /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif -B /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.tif --outfile=/mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif --calc="maximum(A,B)" max file created /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif stormname stormname TCbullsource >> 0. SET INPUT/OUTPUT GFS /mnt/output/GDACS/TC/TCTrack/1000663/AVNO/2020040318/all_inpData.txt error track file-->map without track trackfile 0 151.625 182.125 -28.125 -5.125 lon 123 lat 93 savemap /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg ret: 0 ============================================ 3. Classify meteo + GDACS index score ============================================ >> 3.1. Classify curr + past forecast Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind_stept0.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind_stept0.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind_stept0.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_res_stept0.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind_stept0.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_stept0.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_stept0_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_stept0_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_stept0.xml >> 7. remove files done t0 completed Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.tif. Using internal nodata values (e.g. -999) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_res_all.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_all.xml popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_popfile_all_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18//wind10m_countryfile_all_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_all.xml >> 7. remove files done Creating output file that is 3690P x 2790L. Processing input file /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Using internal nodata values (e.g. 3.40282e+38) for image /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif. Copying nodata values from source /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_res_final.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/lspop20141.tif. Using internal nodata values (e.g. -2.14748e+09) for image /mnt/output/GDACS/DATA/lspop20141.tif. Copying nodata values from source /mnt/output/GDACS/DATA/lspop20141.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 3420P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Creating output file that is 270P x 2790L. Processing input file /mnt/output/GDACS/DATA/countries.tif. Using internal nodata values (e.g. -32768) for image /mnt/output/GDACS/DATA/countries.tif. Copying nodata values from source /mnt/output/GDACS/DATA/countries.tif to destination /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif. 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 270, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. Input file size is 3690, 2790 0...10...20...30...40...50...60...70...80...90...100 - done. t0 completed ============================================ 4. Copy files ============================================ check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200402.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200402.18/20200402.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200402.18/20200402.18_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.00/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.00/20200403.00_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.00/20200403.00_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.06/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.06/20200403.06_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.06/20200403.06_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.12/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.12/20200403.12_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.12/20200403.12_copy_completed_wind.txt check t0 xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_stept0.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues_t0.xml check all xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/20200403.18/wind_popDensValues_all.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/20200403.18/20200403.18_wind.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind.jpg >> !!!! Check Copy !!!! , listfiles_copy , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues.xml , listfiles_all , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues_t0.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues.xml , /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/wind_popDensValues.xml all files copied copycheck: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/20200403.18/20200403.18_copy_completed_wind.txt >> 3.2. Classify final folder /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/20200403.18_final_completed_wind.txt input var: wind10m Input File: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_final.tif hurName: hdate: var: wind10m description: wind10m: _ (GFS) OutDir: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final// PopFile: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif country: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif outxml file: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml xml file exists...REMOVE popfile: LandScan popCellSize= 0.00833333333333 projection= GEOGCS["WGS 84",DATUM["WGS_1984",SPHEROID["WGS 84",6378137,298.257223563,AUTHORITY["EPSG","7030"]],AUTHORITY["EPSG","6326"]],PRIMEM["Greenwich",0],UNIT["degree",0.0174532925199433],AUTHORITY["EPSG","4326"]] >> 1. resample the tif file to the resolution and proj of pop density 0.00833333333333 deg >> 2. read the charactristics of the input file >> 3a. extract a piece of pop. file corresponding to the required bounding box split,rastershift True 1 151.5 -28.25 182.25 -5.0 GFS ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped_outmerge.tif -2147483647.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_popfile_final_clipped.tif 0.00833333333333 >> 3b. extract a piece of countries corresponding to the required bounding box and resolution/proj of pop density **********split ('start clipsplit rastershift', 1) /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif loop over two bbox extract : 151.5 -28.25 180 -5.0 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif loop over two bbox extract : -180 -28.25 -177.75 -5.0 gdal_translate -a_ullr 180 -5.0 182.25 -28.25 /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_2.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif python /mnt/output/GDACS/scripts/gdal_merge.py /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_1.tif /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outtranslate.tif -o /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped_outmerge.tif -32768.0 Final CellSize= /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final//wind10m_countryfile_final_clipped.tif 0.00833333333333 >> 4. classify the vmax file creating another array of values classified cellsize 0.00833333333333 cellsize 0.00833333333333 cellsize 0.00833333333333 >> 5. count the popolation in each cell and assign to the class and write to output >> 6. print / save output in /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml >> 7. remove files done copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/class/final/wind_popDensValues_final.xml in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind_popDensValues.xml copy: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/tif/final/wind_FINAL.jpg in: /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/delft3d/final/wind.jpg ******************************************************* * Case Completed * ******************************************************* Case starterd at: 2020-04-04 00:05:05.008852 UTC Case completed at: 2020-04-04 00:08:41.028856 UTC **********E N D O F J O B*********************** ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:15:05.018770 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ============================================================== ******************************************************* * Storm Surge Calculation System (SSCS) * ******************************************************* Now is : 2020-04-04 00:25:13.573851 UTC inp1= 20200402.18 ncores= 5 var= wind submitting calc 2020-04-02 18:00:00 2020-04-03 18:00:00 delft3d 151.4 182.22 -28.24 -5.0 4.0 GFS 72 15 True GDACS/1000663/1_GFS 6 1 False False 5 20200402.18 6 wind True *************---------------------****************** stormname ndt: 5 it: 0 ndt: 5 idate: 2020-04-02 18:00:00 running case from 2020-04-02 18:00:00 for 6 h start= 1 var wind **** gometeo: 6 listWindows rundate:20200402.18 RUNNING 2020-04-02 18:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 1 ndt: 5 idate: 2020-04-03 00:00:00 running case from 2020-04-03 00:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.00 RUNNING 2020-04-03 00:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 2 ndt: 5 idate: 2020-04-03 06:00:00 running case from 2020-04-03 06:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.06 RUNNING 2020-04-03 06:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 3 ndt: 5 idate: 2020-04-03 12:00:00 running case from 2020-04-03 12:00:00 for 6 h start= 0 var wind **** gometeo: 6 listWindows rundate:20200403.12 RUNNING 2020-04-03 12:00:00 for 6 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created it: 4 ndt: 5 idate: 2020-04-03 18:00:00 running case from 2020-04-03 18:00:00 for 72 h start= 0 var wind **** gometeo: 72 listWindows rundate:20200403.18 RUNNING 2020-04-03 18:00:00 for 72 hours Nothing to do, case already completed ret= -3 newcase= False forceFinal= False forceBulletin= False netcdf already created home dir /mnt/output/SSCS/2020/GDACS/1000663/1_GFS/ ret -3 classifications ============================================ 1. Set INPUT/OUTPUT ============================================ startdate 2020-04-02 18:00:00 currdate 2020-04-03 18:00:00 ndt: 24 delta: 6 nt1=delta 6 nt 72 alldate: DatetimeIndex(['2020-04-02 18:00:00', '2020-04-03 00:00:00', '2020-04-03 06:00:00', '2020-04-03 12:00:00', '2020-04-03 18:00:00'], dtype='datetime64[ns]', freq='6H') ============================================ 2. Processing meteo files: nc2tif ============================================ >> 2.1. Process curr + past files lon0,lon1,lat0,lat1 151.4 182.22 -28.24 -5.0 processing curr bull... 2020-04-03 18:00:00 ********** no new data check copy copy ok copy ok copy ok copy ok copy ok no new data ==============================================================