NWP | ECMWF | IFS | Open data

Open Dataset

ECMWF now provides a much larger open dataset to the public, representing weather forecasts at a higher resolution and a reduction in some release times, after a first set of data was made available in early 2022.

The changes can be summarised as follows:

  • Medium-range data of the Integrated Forecasting System (IFS) are provided at a resolution of 0.25 x 0.25 degrees (28 x 28 km), compared to 0.4 x 0.4 degrees before, and some additional parameters will be added.
  • Medium-range data of the latest beta version of the Artificial Intelligence/Integrated Forecasting System (AIFS) are also available at a resolution of 0.25 x 0.25 degrees.
  • ECMWF’s contribution to the sub-seasonal to seasonal (S2S) dataset, which is part of a global scheme, is now available with a 48-hour delay rather than the previous three-week delay.
  • All parameters of the EU’s Copernicus Atmosphere Monitoring Service (CAMS) that used to a have a six-day embargo are now available in real time.

An overview of open data is given on the ECMWF website.

歐洲中期天氣預報中心 (ECMWF) 的 IFS 模式現在可以作為 0.25 度解析度的開放資料取得。從 2024 年 2 月 1 日 開始，IFS 開放資料分佈的解析度從 0.4 度提高到 0.25 度。這項改進顯著提高了數據精度，尤其是在沿海地區和山區。改進後的分辨率受到了廣泛歡迎，因為之前的 0.4 度分辨率對於許多應用來說太粗糙。

資料下載連結：

https://data.ecmwf.int/forecasts/

規格如下：

  • 解析度從 0.4° 提升至 0.25°
  • 0.25° x 0.25° lat/lon grid or any multiple thereof (global or sub-area)
  • On model (Reduced Gaussian) n320 grid
  • 地表變因：2 公尺氣溫、地表溫度、降水量、氣壓、10 公尺風速
  • 9 個大氣壓力層位提供溫度、濕度或風速數據
  • 10 天預報，時間間隔 3 小時
  • 15 天集合預報，包含 51 個集合成員
  • 每天更新 4 次 (00/06/12/18)
  • 最新測試版的人工智慧/綜合預測系統（AIFS）的中尺度資料也可提供0.25 x 0.25度的解析度
  • 歐洲中期天氣預報中心（ECMWF）對次季節到季節尺度（S2S）資料集的貢獻，作為全球計劃的一部分，現在可以在48小時延遲後獲取，而不是之前的三週延遲
    • 歐洲中期天氣預報中心(ECMWF)在由世界氣象研究計畫(WWRP)和世界氣候研究計畫(WCRP)組織的預測計畫中，對次季節到季節尺度天氣預報也進行了大大減少的延遲。 ECMWF是此計畫的眾多預報中心之一。我們的預報現在只有48小時的延遲，而不是以前的三週延遲。計劃是鼓勵所有次季節性到季節尺度資料提供者同意減少他們的貢獻延遲。更多資訊可以在次季節性到季節尺度存檔頁面上找到（https://confluence.ecmwf.int/display/S2S/S2S+archive）
  • 歐盟的哥白尼大氣監測服務（CAMS）的所有參數，原本需要六天的禁止發布期，現在都可以即時取得
  • 升級後的解析度已無縫整合到 Open-Meteo 天氣 API 中。現在您可以比較 18 個不同天氣模型的預報，評估預報的不確定性並選擇最符合您需求的模型。
  • 0.25° 解析度的 51 個集合成員可以透過 Ensemble API 存取。有關 ECMWF IFS 開放資料計劃的更多詳細信息，請參閱 ECMWF 網站。

憑藉 0.25° 的分辨率，新的 IFS 開放資料模型適用於 Google GraphCast 機器學習模型的實際操作。先前，GraphCast 依賴歐洲地球觀測計畫的 ERA5 資料集，該資料集存在 5 天的延遲，使其不適用於即時預報應用。開放資料 IFS 0.25° 的發布現在允許您每 6 小時執行 GraphCast 並建立機器學習預報。唯一需要注意的是，高效運行 GraphCast 需要一個大型 GPU，但與超級電腦相比，這已經非常划算了。

  • 這些將實現有限區域建模和機器學習初始化。有關即時預測的文件可以在開放資料頁面找到。
  • 最新測試版AIFS的中期數據也以0.25 x 0.25度的解析度提供。這是目前AIFS運作的解析度。有關AIFS的更多信息，包括訪問數據的鏈接，請參閱AIFS機器學習數據頁面（https://www.ecmwf.int/en/forecasts/dataset/aifs-machine-learning-data）。

Snapshot

  • ---Only few days Available--- !!!
  • File format
    • The files are in GRIB edition 2 format, except for trajectories which are in BUFR edition 4 format.
Grib Code Mars Abbreviation Long Name Available model runs
1025 oper Atmospheric model 00z, 12z
1026 scda Atmospheric model (short cutoff) 06z, 18z
1035 enfo Ensemble prediction system 00z, 06z, 12z, 18z
1045 wave Wave model 00z, 12z
1081 waef Wave ensemble forecast

from https://codes.ecmwf.int/grib/format/mars/stream/

Time available (UTC)
Time available (UTC)

ECMWF open data: real-time forecasts from IFS and AIFS (Feb 26, 2025)

Currently, ECMWF open real-time data are available from these locations:

File format

The files are in GRIB edition 2 format, except for trajectories which are in BUFR edition 4 format. We recommend using ecCodes version 2.38.0 or newer to manipulate the GRIB and BUFR files.

File-naming convention

The files are provided with the following naming convention:

1
[ROOT]/[yyyymmdd]/[HH]z/[model]/[resol]/[stream]/[yyyymmdd][HH]0000-[step][U]-[stream]-[type].[format]
  • [ROOT] is the top-level URL of one of the sites hosting the data. See the above for possible values.
  • [yyyymmdd] is the reference date of the forecasts (base date).
  • [HH] is the reference time of the forecasts. Values are 00, 06 , 12 and 18.
  • [model] is the production model (IFS or AIFS). Note: IFS and AIFS have different options, so please be review dataset pages to see what is available.
  • [resol] is the horizontal resolution of the data. Options include: 0p25
  • [stream] is the forecasting system that produces the data. Values are:
    • oper - high-resolution forecast, atmospheric fields
    • enfo - ensemble forecast, atmospheric fields (not applicable for AIFS model)
    • waef - ensemble forecast, ocean wave fields, (not applicable for AIFS model)
    • wave - wave model, (not applicable for AIFS model)
    • scda - short cut-off high-resolution forecast, atmospheric fields (also known as "high-frequency products") (not applicable for AIFS model)
    • scwv - short cut-off high-resolution forecast, ocean wave fields (also known as "high-frequency products") (not applicable for AIFS model) and
    • mmsf - multi-model seasonal forecasts fields from the ECMWF model only (not applicable for AIFS model).
  • [step] is the forecast time step expressed in units U
  • [U] is the unit used for the time step. Values are h for hours and m for month. The latter is only valid for seasonal forecasts (mmsf).
  • [type] is once of fc (forecast), ef (ensemble forecast), ep (ensemble probabilities) or tf (trajectory forecast for tropical cyclone tracks).
  • [format] is grib2 for all fields, and bufr for the trajectories.

The valid combinations of the above are:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
format=bufr, type=tf 
   HH=00/12 
  	  stream=enfo/oper, step=240h 
   HH=06/18 
      stream=enfo, step=144h 
      stream=scda, step=90h 
format=grib2 
   HH=00/12 
      stream=enfo/waef 
        type=ef, step=0h to 144h by 3h, 144h to 360h by 6h 
        type=ep, step=240h/360h 
      stream=oper, wave 
        type=fc, step=0h to 144h by 3h, 144h to 240h by 6h 
   HH=06/18 
      stream=enfo/waef 
        type=ef, step=0h to 144h by 3h 
      stream= scda /scwv 
        type=fc, step=0h to 90h by 3h 
   HH=00 
   	  stream=mmsf, type=fc, u=m, step=1m to 7m

via Herbie

Variables

Single level - forecast

Short Name ID Long Name Units Additional information
z 129 Geopotential m^2 s^-2
msl 151 Mean sea level pressure Pa
sdor 160 Standard deviation of sub-gridscale orography m
slor 163 Slope of sub-gridscale orography Numeric
10u 165 10 metre U wind component m s^-1
10v 166 10 metre V wind component m s^-1
2t 167 2 metre temperature K
2d 168 2 metre dewpoint temperature K
ssrd 169 Surface short-wave (solar) radiation downwards J m^-2
lsm 172 Land-sea mask (0-1)
strd 175 Surface long-wave (thermal) radiation downwards J m^-2
lcc 3073 Low cloud cover %
mcc 3074 Medium cloud cover %
hcc 3075 High cloud cover %
rowe 231002 Runoff water equivalent (surface plus subsurface) kg m^-2
cp 228143 Convective precipitation kg m^-2
sf 228144 Snowfall kg m^-2
tcc 228164 Total cloud cover %
tp 228228 Total precipitation kg m^-2
100u 228246 100 metre U wind component m s^-1
100v 228247 100 metre V wind component m s^-1

Pressure level - forecast

  • All parameters are available at levels 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 hPa
SHORT NAME ID LONG NAME UNITS ADDITIONAL INFORMATION
z 129 Geopotential m^2 s^-2
t 130 Temperature K
u 131 U component of wind m s^-1
v 132 V component of wind m s^-1
q 133 Specific humidity kg kg^-1
w 135 Vertical velocity Pa s^-1

Soil level - forecast

  • All parameters are available at levels 1, 2
SHORT NAME ID LONG NAME UNITS ADDITIONAL INFORMATION
vsw 260199 Volumetric soil moisture m^3 m^-3
sot 260360 Soil temperature K

open-data variables

IFS data High-resolution products:

Steps:

  • For times 00z &12z: 0 to 144 by 3, 150 to 360 by 6.
  • For times 06z & 18z: 0 to 144 by 3.
  • Type of level data:

Surface (sfc), Surface Other level (sol) and Pressure Level (pl)

Pressure levels available (hPa): 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50

Only a single ID is used for Volumetric soil water and Soil Temperature with layer 1 having level=1, layer 2 having level=2 etc. Layers 1-4 are available.

Short name Long name ID Type of level
z Geopotential (step 0) 129 sfc
sdor Standard deviation of sub-gridscale orography (step 0) 160 sfc
slor Slope of sub-gridscale orography (step 0) 163 sfc
10u 10 metre U wind component 165 sfc
10v 10 metre V wind component 166 sfc
100u 100 metre U wind component 228246 sfc
100v 100 metre V wind component 228247 sfc
10fg Maximum 10 metre wind gust since previous post-processing - (appears as 10fg3 for steps 3 to 144) 49 / 228028 sfc
2t 2 metre temperature 167 sfc
2d 2 metre dewpoint temperature 168 sfc
msl Mean sea level pressure 151 sfc
mp2 Mean zero-crossing wave period 140221 sfc
mwd Mean wave direction 140230 sfc
mwp Mean wave period 140232 sfc
pp1d Peak wave period 140231 sfc
swh Significant height of combined wind waves and swell 140229 sfc
ro Runoff 205 sfc
tp Total Precipitation 228 sfc
sp Surface pressure 134 sfc
st Soil temperature 228139 sfc
tcwv Total column vertically-integrated water vapour 137 sfc
lsm Land Sea Mask 172 sfc
vsw Volumetric soil water (layers 1-4) 260199 sol
sot Soil temperature (layers 1-4) 260360 sol
mucape Most-unstable convective available potential energy 228235 sfc
asn Snow albedo 32 sfc
mn2t3 Minimum temperature at 2 metres in the last 3 hours 228027 sfc
mx2t3 Maximum temperature at 2 metres in the last 3 hours 228026 sfc
mn2t6 Minimum temperature at 2 metres in the last 6 hours 122 sfc
mx2t6 Maximum temperature at 2 metres in the last 6 hours 121 sfc
tprate Total precipitation rate 260048 sfc
ptype Precipitation type 260015 sfc
ttr Top net long-wave (thermal) radiation 179 sfc
str Surface net long-wave (thermal) radiation 177 sfc
ssr Surface net short-wave (solar) radiation 176 sfc
ssrd Surface net short-wave (solar) radiation downwards 169 sfc
strd Surface net long-wave (thermal) radiation downwards 175 sfc
nsss Time-integrated northward turbulent surface stress 181 sfc
ewss Time-integrated eastward turbulent surface stress 180 sfc
t20d Depth of 20C isotherm - currently unavailable (11/03/2024) sfc
sav300 Average salinity in the upper 300m - currently unavailable (11/03/2024) sfc
ocu Eastward sea water velocity - currently unavailable (11/03/2024) sfc
ocv Northward sea water velocity - currently unavailable (11/03/2024) sfc
sithick Sea ice thickness 262000 sfc
zos Sea surface height 262124 sfc
d Divergence 155 pl
gh Geopotential height 156 pl
q Specific humidity 133 pl
r Relative humidity 157 pl
t Temperature 130 pl
u U component of wind 131 pl
v V component of wind 132 pl
w Vertical velocity 135 pl
vo Vorticity (relative) 138 pl

rda.ucar: ECMWF IFS High-Resolution Operational Forecasts

From rda.ucar (Not use)

  • https://rda.ucar.edu/datasets/d113001/#
    • ECMWF has implemented a significant resolution upgrade and methodology for high-resolution forecasts (HRES) and ensemble forecasts (ENS) beginning January of 2016. HRES is now performed via a transform grid with a nominal grid point spacing of 9 kilometers (0.08 degrees), and is carried out with IFS (Integrated Forecast System).
    • ECMWF Operational 6-hourly atmospheric surface forecast
    • ECMWF Operational 6-hourly atmospheric isobaric analysis

Herbie

NWP | Herbie | Download NWP model output (grib2) | MPAS | WRF

Download script

  • wget [ROOT]/20240301/00z/ifs/0p25/oper/20240301060000-24h-oper-fc.grib2
  • wget [ROOT]/20240301/06z/ifs/0p25/scda/20240301060000-24h-scda-fc.grib2
  • wget [ROOT]/20240301/12z/ifs/0p25/wave/20240301060000-12h-wave-fc.grib2
  • wget [ROOT]/20240301/06z/ifs/0p25/scwv/20240301060000-18h-scwv-fc.grib2
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
#!/bin/sh
#################################################################
# https://data.ecmwf.int/forecasts/20241117/00z/ifs/0p25/oper/
# https://data.ecmwf.int/forecasts/20241117/00z/ifs/0p25/oper/20241117000000-114h-oper-fc.grib2
#################################################################

yyyy='2024'
mm='11'
dd='17'
hh='00'
yyyymm=${yyyy}${mm}
yyyymmddhh=${yyyy}${mm}${dd}${hh}

tmp_dir="${yyyy}${mm}/${yyyy}${mm}${dd}"
mkdir -p ${tmp_dir}
cd ${tmp_dir}
echo "Current ${tmp_dir}"

limit_cpu_core=15
count_cpu_core=1

for ifsfile in $(seq 0 3 6); do # Forecast time = 12, 24, 36, 48, 60, 72, 84, 96, 108, 130, 142, 154

    tmp_ifs_fname="${yyyymmddhh}0000-${ifsfile}h-oper-fc.grib2"
	echo "Now, ${tmp_ifs_fname} ... "
    
		echo "Downloading ... ${tmp_ifs_fname}"
		wget -c --no-check-certificate https://data.ecmwf.int/forecasts/${yyyy}${mm}${dd}/${hh}z/ifs/0p25/oper/${tmp_ifs_fname}
    
	res=$(( ${count_cpu_core} % ${limit_cpu_core} ))
	if [[ ${res} == 0 ]]; then
		echo "please wait ${tmp_ifs_fname}, ${count_cpu_core}, ${res}."
		wait
	fi
    
done

read grib2

read_grib2.py

1
2
3
4
5
6
7
#!/bin/python
import pygrib

grib_file = "/home/wpsze/IFS/202411/20241117/20241117000000-0h-oper-fc.grib2"
grbs = pygrib.open(grib_file)
for grb in grbs:
    print(grb) # long list

zero-padding

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
#!/bin/bash

#set -e # stop the shell on first error
#set -u # fail when using an undefined variable
#set -x # echo script lines as they are executed
set -o pipefail

source /home/wpsze/micromamba/bin/activate venv
export SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" >/dev/null 2>&1 && pwd )"

for file in *h-oper-fc.grib2; do
    # Check if the filename matches the pattern (prefix-number-suffix)
    if [[ $file =~ (.*-)([0-9]+)(h-.*) ]]; then
        prefix="${BASH_REMATCH[1]}"
        hour="${BASH_REMATCH[2]}"
        suffix="${BASH_REMATCH[3]}"
        
        # Format the hour to be 3 digits with leading zeros
        padded_hour=$(printf "%03d" "$hour")
        
        # Rename the file
        mv "$file" "${prefix}${padded_hour}${suffix}"
    fi
done

Run as ICBC

I recognised that the Vtable.ECMWF you have mentioned was not suitable for the IFS forecast data, due to the data form of the IFS was grib2. But the Vtable.ECMWF was for grib.

https://github.com/wrf-model/WPS/blob/master/ungrib/Variable_Tables/Vtable.ECMWF

MPAS/WRF

ungrib

Solution:

  • Using Newer ECMWF Data | kwerner | Sep 28, 2024
    • The new EC grib2 data requires an additional step to convert from EC grib2 data to grib2 data WPS supports. The conversion can be done by using the convert command in the ecCodes library which is available from ECMWF. The conversion step follows the following format: 
      1
      2
      $ grib_set -r -w packingType=grid_ccsds -s packingType=grid_simple input.grib2 output.grib2
      $ grib_set -r -w packingType=grid_ccsds -s packingType=grid_simple 20250326000000-0h-oper-fc.grib2 ifs_20250326000000-0h-oper-fc.grib2
    • The updated Vtable.ECMWF in WPS v4.6 should work with the converted grib2 data.
    • I think this could be related to CCSDS compression. You can change the packing type by using eccodes for instance.
    • Hi Everyone, One of the problems with the EC data is that it's not all standardized like GFS data. Depending on where/how the data are obtained, they can be different. We've found that, for e.g., for one user, ungrib is unable to recognize the soil fields. A possible solution for this is to use GFS soil data, in addition to the EC data. We expect the output to still be reasonable, especially because the WRF LSMs are more like that used by GFS. We hope to have a better solution for this issue in the future. For additional information, see this thread in our GitHub code repository (I believe one of you is the one who was having the discussion with my colleague).
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
GRIB1| Level| From |  To  | metgrid  | metgrid  | metgrid                                  |GRIB2|GRIB2|GRIB2|GRIB2|
Param| Type |Level1|Level2| Name     | Units    | Description                              |Discp|Catgy|Param|Level|
-----+------+------+------+----------+----------+------------------------------------------+-----------------------+
 129 | 100  |   *  |      | GEOPT    | m2 s-2   |                                          |  0  |  0  |     | 100 |
 156 | 100  |   *  |      | HGT      | m        | Height                                   |  0  |  3  |  5  | 100 |  
 130 | 100  |   *  |      | TT       | K        | Temperature                              |  0  |  0  |  0  | 100 |
 131 | 100  |   *  |      | UU       | m s-1    | U                                        |  0  |  2  |  2  | 100 |
 132 | 100  |   *  |      | VV       | m s-1    | V                                        |  0  |  2  |  3  | 100 |
 157 | 100  |   *  |      | RH       | %        | Relative Humidity                        |  0  |  1  |  1  | 100 |
 165 |  1   |   0  |      | UU       | m s-1    | U                    At 10 m             |  0  |  2  |  2  | 103 | 
 166 |  1   |   0  |      | VV       | m s-1    | V                    At 10 m             |  0  |  2  |  3  | 103 | 
 167 |  1   |   0  |      | TT       | K        | Temperature          At  2 m             |  0  |  0  |  0  | 103 |
 168 |  1   |   0  |      | DEWPT    | K        |                                          |  0  |  0  |  6  | 103 |
     |  1   |   0  |      | RH       | %        | Relative Humidity    At  2 m             |  0  |  0  |     | 103 | 
 172 |  1   |   0  |      | LANDSEA  | 0/1 Flag | Land/Sea flag                            |  2  |  0  |  0  |  1  | 
 129 |  1   |   0  |      | SOILGEO  | m2 s-2   |                                          |  0  |  0  |     | 103 | 
 156 |  1   |   0  |      | SOILHGT  | m        | Terrain field of source analysis         |  0  |  0  |     | 106 | 
 134 |  1   |   0  |      | PSFC     | Pa       | Surface Pressure                         |  0  |  3  |  0  |  1  |
 151 |  1   |   0  |      | PMSL     | Pa       | Sea-level Pressure                       |  0  |  3  |  0  | 101 |
 235 |  1   |   0  |      | SKINTEMP | K        | Sea-Surface Temperature                  |  0  |  3  |     | 101 |
  31 |  1   |   0  |      | SEAICE   | 0/1 Flag | Sea-Ice-Flag                             |  0  |  3  |     | 101 |
  34 |  1   |   0  |      | SST      | K        | Sea-Surface Temperature                  |  0  |  3  |     | 101 |
 141 |  1   |   0  |      | SNOW_EC  | m        |                                          |  0  |  3  |     | 101 |
     |  1   |   0  |      | SNOW     | kg m-2   |Water Equivalent of Accumulated Snow Depth|  0  |  3  |     | 101 |
 139 | 112  |   0  |   7  | ST000007 | K        | T of 0-7 cm ground layer                 |  2  |  0  |  2  | 106 | 
 170 | 112  |   7  |  28  | ST007028 | K        | T of 7-28 cm ground layer                | 192 | 128 | 170 | 106 | 
 183 | 112  |  28  | 100  | ST028100 | K        | T of 28-100 cm ground layer              | 192 | 128 | 183 | 106 | 
 236 | 112  | 100  | 255  | ST100289 | K        | T of 100-289 cm ground layer             | 192 | 128 | 236 | 106 | 
  39 | 112  |   0  |   7  | SM000007 | fraction | Soil moisture of 0-7 cm ground layer     | 192 | 128 | 39  | 106 | 
  40 | 112  |   7  |  28  | SM007028 | fraction | Soil moisture of 7-28 cm ground layer    | 192 | 128 | 40  | 106 | 
  41 | 112  |  28  | 100  | SM028100 | fraction | Soil moisture of 28-100 cm ground layer  | 192 | 128 | 41  | 106 | 
  42 | 112  | 100  | 255  | SM100289 | fraction | Soil moisture of 100-289 cm ground layer | 192 | 128 | 42  | 106 | 
-----+------+------+------+----------+----------+------------------------------------------+-----+-----+-----+-----+
#
#  Grib codes are from Table 128 
#  http://old.ecmwf.int/publications/manuals/d/gribapi/param/filter=grib1/order=paramId/order_type=asc/p=1/table=128/
#  
#  snow depth is converted to the proper units in rrpr.F
#
#  Tested on NCAR/RDA ds113.0 dataset. http://rda.ucar.edu/datasets/ds113.0/
#  Note that for ds113.0 there is one surface data file per day and 4 pressure-level files per day.
  • Vtable error of ECMWF,pls update it | Oct 13, 2024
    • Surface data including soil data may come from grib 1 data. You may need to use eccodes to separate out grib 2 and grib 1 data first before running ungrib. We are not supporting the new enfo data yet. Please post further issue on the Forum.
    • they are loss soil data.
    • It looks like the grib code for soil data has been messed up somehow. For the time being, you can try to use GFS soil data together with the EC atmospheric data. If you need help doing so, try reading the WPS section of the User's Guide.
    • Please read carefully this section of the User's Guide for using combined datasets.
  • Change in soil variables from ECMWF Cycle 49r1 | Nov 14, 2024
    • On Tuesday (November 12), ECMWF released the 49r1 version of the operational IFS. Despite all the improvements, they modified the soil variables (temperature and humidity) which stopped the ECMWF Vtable that had been released in the 4.6.0 version of the WPS.
    • WPS still can't find the soil temperature and moisture variables.
    • I contacted the ECMWF team and they gave me this feedback. It is necessary to make a change within Ungrib, more specifically in the rd_grib2.F code so that it works with the new IFS soil variables.
    • [Jan 3, 2025] Please take a look at this document-Change in soil variables from ECMWF Cycle 49r1 , which fixes the issues related to the ECMWF 49r1 version of the operational IFS. ECMWF 49r1 is newly released and we haven't done sufficient tests to make sure it works fine for WRF. Please post any issues you may have, which will be helpful for us to implement this data for WRF modeling study. Thanks in advance.
    • [Jan 4, 2025] Please download the modified code "rd_grib2.F" from the website update era5/ifs soil field processing by jimbresch · Pull Request #266 · wrf-model/WPS, recompile WPS, then rerun ungrib.exe.
    • IFS operational model data in the ECMWF open data repository are only available for the last 4 days.
    • [Jan 15, 2025] As requested, I am providing the corrected rd_grib2F file for WPS 4.5 and my Vtable.ECMWF_GRIB2 file. For the new WPS 4.6 version, I have not yet prepared a correction for the IFS model.
    • [Jan 16, 2025] I run WPS using your rd_grib2.F and Vtable. All work fine. Thank you! The met-em file I generated only has 14 pressure levels in the vertical, --- is this what you got?
    • [Jan 16, 2025] Yes, the IFS model provided by ECMWF has only 14 pressure levels. I made a simulation with the operational IFS model at 137 hybrid levels, which we have access to at the Institute of Meteorology and Water Management. The results are similar to the results from the IFS model, which is provided as open data. This is good news.
    • [14 Jan, 2025] I have already tested this Vtable.ECMWF with the new operational IFS data and it doesn't work either. I reported this here.

recompile WPS, then rerun ungrib.exe

  • under ungrib/src,
    • rd_grib2.F
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
GRIB1| Level| From |  To  | metgrid  | metgrid  | metgrid                                  |GRIB2|GRIB2|GRIB2|GRIB2|
Param| Type |Level1|Level2| Name     | Units    | Description                              |Discp|Catgy|Param|Level|
-----+------+------+------+----------+----------+------------------------------------------+-----------------------+
 129 | 100  |   *  |      | HGT      | m        | Height                                   |  0  |  3  |  5  | 100 |
 130 | 100  |   *  |      | TT       | K        | Temperature                              |  0  |  0  |  0  | 100 |
 131 | 100  |   *  |      | UU       | m s-1    | U                                        |  0  |  2  |  2  | 100 |
 132 | 100  |   *  |      | VV       | m s-1    | V                                        |  0  |  2  |  3  | 100 |
 157 | 100  |   *  |      | RH       | %        | Relative Humidity                        |  0  |  1  |  1  | 100 |
 165 |  1   |   0  |      | UU       | m s-1    | U                 at 10 m                |  0  |  2  |  2  | 103 |
 166 |  1   |   0  |      | VV       | m s-1    | V                 at 10 m                |  0  |  2  |  3  | 103 |
 167 |  1   |   0  |      | TT       | K        | Temperature       at  2 m                |  0  |  0  |  0  | 103 |
 168 |  1   |   0  |      | DEWPT    | K        |                                          |  0  |  0  |  6  | 103 |
     |  1   |   0  |      | RH       | %        | Relative Humidity at 2 m                 |  0  |  1  |  1  | 103 |
 172 |  1   |   0  |      | LANDSEA  | 0/1 Flag | Land/Sea flag (1=land, 0 or 2=sea)       |  2  |  0  |  0  |   1 |
 134 |  1   |   0  |      | PSFC     | Pa       | Surface Pressure                         |  0  |  3  |  0  |   1 |
 151 |  1   |   0  |      | PMSL     | Pa       | Sea-level Pressure                       |  0  |  3  |  0  | 101 |
 235 |  1   |   0  |      | SKINTEMP | K        | Skin temperature                         |  0  |  0  | 17  |   1 |
  18 | 112  |   0  |   7  | ST000007 | K        | T of 0-7 cm  ground layer                |  2  |  3  |  18 | 151 | 
  18 | 112  |   7  |  28  | ST007028 | K        | T of 7-28 cm ground layer                |  2  |  3  |  18 | 151 | 
  18 | 112  |  28  | 100  | ST028100 | K        | T of 28-100 cm ground layer              |  2  |  3  |  18 | 151 | 
  18 | 112  | 100  | 289  | ST100289 | K        | T of 100-289 cm ground layer             |  2  |  3  |  18 | 151 | 
  25 | 112  |   0  |   7  | SM000007 | m3 m-3   | Soil moisture of 0-7 cm ground layer     |  2  |  0  |  25 | 151 | 
  25 | 112  |   7  |  28  | SM007028 | m3 m-3   | Soil moisture of 7-28 cm ground layer    |  2  |  0  |  25 | 151 | 
  25 | 112  |  28  | 100  | SM028100 | m3 m-3   | Soil moisture of 28-100 cm ground layer  |  2  |  0  |  25 | 151 | 
  25 | 112  | 100  | 289  | SM100289 | m3 m-3   | Soil moisture of 100-289 cm ground layer |  2  |  0  |  25 | 151 | 
-----+------+------+------+----------+---------+-----------------------------------------+-------------------------+
#

Vtable.ECMWF_GRIB2/Vtable.ECMWF

1
2
-rw-rw-r-- 1 wpsze wpsze 321M Apr  1 16:27 ERA5:2025-03-26_00-ECMWF_GRIB2
-rw-rw-r-- 1 wpsze wpsze 286M Apr  1 14:26 ERA5:2025-03-26_00-Vtable.ECMWF
  • The intermediate file (ERA5.xxx) by Vtable.ECMWF_GRIB2 is larger file size than that of Vtable.ECMWF
  • ERA5.xxx by Vtable.ECMWF fails in init_atmosphere_model step.

Updated (2025-12-15)

init_atmosphere_model

Error

  • MPASv7.3 init_atmosphere_model
1
2
3
4
ERROR: extrap_type == 2 not implemented for target_z >= zf(1,nz)
ERROR: *****************************************************************
ERROR: Error in interpolation of t(k,iCell) for k=  46, iCell=         1
CRITICAL ERROR: ********************************************************
  • set 'linear',
1
2
3
&interpolation_control
    config_extrap_airtemp = 'linear'
/
1
CRITICAL ERROR: Error in interpolation of st_fg to MPAS grid: num_st = 27244
  • Error creating initial conditions with NCEP FNL ds083.2 | May 8, 2024
    • I'm trying to create the initial conditions file for MPAS (v8.1) using data obtained from the NCEP FNL ds083.2
    • Just had to change config_nfgsoillevels to 2 and config_extrap_airtemp to linear in namelist.init_atmosphere. Once those two modifications were made init_atmosphere_model and atmosphere_model ran without issues.
    • Note that FNL data only contains 2-level of soil information, which is why we need to set config_nfgsoillevels=2. The top of the FNL data is 10 hpa, and therefore extrapolation is needed if MPAS top level is above 10 hpa.
    • For the option of config_extrap_airtemp, would you please let me know what is the model top of your MPAS run? Thanks.
  • Initial condition CRITICAL ERROR: Error in interpolation of st_fg to MPAS | Feb 16, 2024
  • 'Error in interpolation of st_fg to MPAS grid' with variable-resolution mesh simulation | Jul 23, 2020
    • The error message generally indicates that there are grid cells that have a soil temperature value less than or equal to zero.
    • I solved the problem by downloading the "Vtable from the RDR page/WRF" and using WPS version 4.0 or higher.
  • CRITICAL ERROR: Error in interpolation of st_fg to MPAS grid | Start dateMay 3, 2019
    • This error message is an indication that there were one or more points in the MPAS mesh that received a zero or negative value for soil temperature.
    • Can you also verify that there are soil moisture and soil temperature fields in your WPS intermediate file, and that the number of soil levels in your intermediate files matches the value of the config_nfgsoillevels in your namelist.init_atmosphere file?
  • CRITICAL ERROR: Error in interpolation of st_fg to MPAS grid: num_st = 18642 | Apr 12, 2023
    • MPAS can only process soil data at specific levels with specific field names. If your input soil data are on levels or with names unrecognized by MPAS, then it won't work.
    • Please take a look at the code "mpas_init_atm_cases.F", and the lines 3908 - 4118 process soil temperature data. This might give you some idea how MPAS works.
  • Trying to Use RAP as IC/BC | Start dateJun 26, 2019
    • The message "Error in interpolation of st_fg to MPAS grid: num_st = XXXX" is generally indicative of an issue with the soil temperature. Would it be possible to use some of the utilities that come with the WRF Pre-processing System (WPS) to check that there are valid soil temperature data in your intermediate file? Specifically, you could use the "rd_intermediate" utility to check that there are fields named, e.g., ST000010, and you could use the "int2nc" utility to convert the intermediate file to netCDF format, where it would be easier to view the soil fields with, e.g., ncview.
  • Use WPSv4.6 with above renewed Vtable and rd_grib2.F

One more issue, 資料集可用性 2024-11-12T12:00:00Z–2025-04-16T12:00:00Z

  • 資料集可用性 2024-11-12T12:00:00Z–2025-04-16T12:00:00Z
  • The grib files from ecmwf.ini and from aws are different. It will make different/debug on the ungrib step and init_atmosphere_model step.
    • Not all different.

It is because,

parameter "config_nfglevels"

  • configuration problem for parameter "config_nfglevels" | Sep 2, 2021
    • If you have 37 isobaric levels of atmospheric data, plus surface fields (u10, v10, t2, etc.), that would give a total of 38 levels from the perspective of the init_atmosphere_model program. As the error message states, config_nfglevels must therefore be set to at least 38 -- so value of 38, 39, 40, 41, etc. should all work.
    • Internally, the 'config_nfglevels' namelist option is used by the init_atmosphere_model program to allocate 3-d arrays to hold the horizontally interpolated first-guess ("fg" in the config_nfglevels name) fields. Allocating too few vertical levels in these 3-d arrays is problematic, but allocating extra levels -- which will simply go unused -- isn't a problem, though it does waste memory.

Done

1
MPAS-120km_2022063000.init.nc

and MPASv7.3 runs (./atmosphere_model) with IFS successfully as well (both with Vtable.ECMWF_GRIB2 above).

cronjob

For 00z,

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
#!/bin/sh
#################################################################
# https://data.ecmwf.int/ecpds/home/opendata/20250402/00z/ifs/0p25/oper/20250402000000-0h-oper-fc.grib2
#################################################################
source /home/wpsze/micromamba/etc/profile.d/micromamba.sh
micromamba activate venv

BASE_DIR=$(pwd)
echo "Base Dir = ${BASE_DIR}"

for ifsday in $(seq 0 1 3); do # day-shift = 0, 1, 2, 3

    YYYYMMDDHH=$(date -d "today - ${ifsday} day" +%Y%m%d00)

    yyyy=${YYYYMMDDHH:0:4}
    mm=${YYYYMMDDHH:4:2}
    dd=${YYYYMMDDHH:6:2}
    hh=${YYYYMMDDHH:8:2}

    yyyymm=${yyyy}${mm}
    yyyymmdd=${yyyy}${mm}${dd}

    tmp_dir="./${yyyy}${mm}/${yyyy}${mm}${dd}"
    mkdir -p ${tmp_dir}
    cd ${tmp_dir}
    echo "Current Dir: $(pwd)"

    limit_cpu_core=15
    count_cpu_core=1

    #============== 00z ===================================
    tmp_ifs_fname="${YYYYMMDDHH}0000-0h-oper-fc.grib2"

    echo "Now, ${tmp_ifs_fname} ... "

	    echo "Downloading ... ${tmp_ifs_fname}"
	    #wget -c --no-check-certificate https://data.ecmwf.int/forecasts/${yyyy}${mm}${dd}/00z/ifs/0p25/oper/${tmp_ifs_fname}
	    wget -c --no-check-certificate https://data.ecmwf.int/ecpds/home/opendata/${yyyy}${mm}${dd}/00z/ifs/0p25/oper/${tmp_ifs_fname}


    res=$(( ${count_cpu_core} % ${limit_cpu_core} ))
    if [[ ${res} == 0 ]]; then
	    echo "please wait ${tmp_ifs_fname}, ${count_cpu_core}, ${res}."
	    wait
    fi
    
    cd ${BASE_DIR}
done

Dissemination schedule

Time available (UTC)
Time available (UTC)
  • HKT = UTC + 8
  • How to set the crontab: $ crontab -e
1
2
$ crontab -l
30 17 * * * cd /home/wpsze/mpas/IFS; sh wpsze_download_IFS-cronjob-00z.sh

References

  1. ECMWF releases a much larger open dataset | 29 February 2024
  2. Open data | ECMWF real-time forecast data
  3. ECMWF IFS 免费开放预报升级到 0.25° 分辨率 | 2024年02月26日
  4. 重大升级！欧洲中期天气预报中心AI加持下免费开放了更高分辨率、更多参数的气象数据！| 2024年03月01日
NWP
#WRF #WPS #MPAS #IC/BC #ECMWF #IFS
NWP | ECMWF | IFS | Open data
https://waipangsze.github.io/2024/11/12/ECMWF-IFS/
Author
wpsze
Posted on
November 12, 2024
Updated on
January 15, 2026
Licensed under