google-research/weatherbench2 issues and pull requests

#230 - Example commands for ensemble evaluation does not work

Issue - State: closed - Opened by azrael417 4 days ago - 5 comments

#229 - Units of `prediction_timedelta` (i.e. lead time)

Issue - State: closed - Opened by oliverangelil 5 days ago - 1 comment

#228 - WB-X update

Pull Request - State: open - Opened by raspstephan 7 days ago

#227 - Add test that checks the integral (w.r.t. threshold) of DebiasedEnsembleBrierScore

Pull Request - State: open - Opened by copybara-service[bot] 25 days ago

#226 - Register WB2 data on HF datasets?

Issue - State: open - Opened by alxmrs 29 days ago - 4 comments

#225 - It seems that the 240x121 climatology (1.5 degree) file contains lots of Nan value with the variable "total_precipitation_6hr_seeps_threshold"

Issue - State: open - Opened by ShileiCao about 1 month ago - 1 comment

#224 - No permission to access Google Cloud Storage gs://weatherbench2？

Issue - State: closed - Opened by melodicdeath about 2 months ago - 2 comments

#223 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] about 2 months ago - 1 comment

#222 - Bump jinja2 from 3.1.2 to 3.1.5 in /docs

Pull Request - State: open - Opened by dependabot[bot] about 2 months ago
Labels: dependencies

#221 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] about 2 months ago - 1 comment

#220 - slice_dataset now casts --sel "start/stop" flags to string (to agree with API documentation) and "step" to int (because step must be an int in xarray).

Pull Request - State: closed - Opened by copybara-service[bot] 2 months ago

#219 - Are there plans to provide the SEEPS score of tp_6hr for Fuxi and the statistics of the variable such as mean and std?

Issue - State: closed - Opened by ShileiCao 2 months ago - 2 comments

#218 - aggregating and preparing data from the Climate Data Store

Issue - State: closed - Opened by briansynthetaic 2 months ago - 1 comment

#217 - The results of SEEPS for TP_6hr is not consistent with the one in the Cloud Storage.

Issue - State: closed - Opened by ShileiCao 2 months ago - 2 comments

#216 - Could you please provide an example of calculating SEEPS score

Issue - State: closed - Opened by ShileiCao 2 months ago

#215 - abnormal negative values in the precipitation related data

Issue - State: closed - Opened by ShileiCao 2 months ago - 2 comments

#214 - it seems the climatology file in the evaluation.ipynb quick setup guide seems to be missing

Issue - State: closed - Opened by ShileiCao 2 months ago - 3 comments

#213 - Change default TIMEDELTA_SPACING from 12h to 6h. This is in line with what we do for our evals.

Pull Request - State: closed - Opened by copybara-service[bot] 2 months ago

#212 - Add SOURCE_TIME variable to probabilistic climatological forecasts. This allows

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#211 - Update weatherbench deps.

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#210 - Urgent about LSTM model used on weatherbench2

Issue - State: open - Opened by aliamrrr 3 months ago - 1 comment

#209 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 3 months ago

#208 - --levels FLAG added to compute_probabilistic_climatological_forecasts. Allows selecting designated levels from input path.

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#207 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 3 months ago

#206 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 3 months ago

#205 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 3 months ago

#204 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 3 months ago

#203 - NaN values in NeuralGCM ensemble

Issue - State: closed - Opened by gcouairon 3 months ago - 3 comments

#202 - Add reshuffle to optimize WeatherBench2 evaluation

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#201 - Replace `dims` with `sizes` in weatherbench2.

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#200 - `compute_probabilistic_climatological_forecasts.py` added to `weatherbench2/scripts`.

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#199 - Add spatial threshold-based ensemble metrics

Pull Request - State: closed - Opened by copybara-service[bot] 3 months ago

#198 - Scorecard functionality request: show multi experiments + annotations

Issue - State: open - Opened by smaticka 3 months ago - 1 comment

#197 - Data request: renewable energy impact variables

Issue - State: open - Opened by jthuemmel 3 months ago - 3 comments

#196 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#195 - Trim dropped dims from chunks in WB/scripts/compute_averages.py

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#194 - Add `--drop_sel` and `--drop_isel` capability to `slice_dataset.py`, as well as the ability to handle lists of selection arguments.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#193 - `--index_on_timedelta` FLAG added to `convert_init_to_valid_time.py`.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#192 - Lint fixes in Weatherbench to satisfy Copybara's invocation of pyink. This is a submission blocker for child CLs.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#191 - slice_dataset BUGFIX: Remove dropped dims from chunks

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#190 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago

#189 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago

#188 - `compute_quantiles` added to `.../weatherbench2/scripts/`

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#187 - `--skipna` FLAG added to weatherbench scripts.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#186 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#185 - Clarify computation of accumulated precipitation in docstring and tests.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#184 - RMSE scores on website differ from those on the corresponding Google Cloud dataset

Issue - State: open - Opened by cindyl983 5 months ago - 1 comment

#183 - Misc. fixes for newer versions of Xarray

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#182 - Misc. fixes for newer versions of Xarray

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#181 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#180 - * Allow `--variables` in `compute_ensemble_mean`

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#179 - `resample_in_time` `BUGFIX`. Since the input dataset is modified (e.g. some variables dropped), some `input_chunks` will no longer be valid. This CL removes those dims from `input_chunks` to prevent missing dims errors.

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#178 - Evaluate Persistence does not work

Issue - State: open - Opened by bar35643 6 months ago

#177 - What region is data stored in?

Issue - State: open - Opened by jrbourbeau 6 months ago - 2 comments

#176 - BUGFIX `compute_zonal_energy_spectrum.py` so it uses `BASE_VARIABLES` to filter the `source` Dataset right from the start. This means the dimensions in (the filtered) `source` will be the same as in the output.

Pull Request - State: closed - Opened by copybara-service[bot] 7 months ago

#175 - [numpy] Fix users of NumPy APIs that are removed in NumPy 2.0.

Pull Request - State: closed - Opened by copybara-service[bot] 7 months ago

#174 - The production of the low resolution prediction results

Issue - State: open - Opened by rs-lsl 7 months ago - 3 comments

#173 - Possible bug with xarray dataset selection within beam

Issue - State: closed - Opened by jdwillard19 7 months ago - 2 comments

#172 - Possible bug in schema.apply_time_conventions (?)

Issue - State: open - Opened by timothyas 7 months ago

#171 - conservative regridding with land-sea mask

Issue - State: open - Opened by markmbaum 8 months ago

#170 - Allow later compatible versions of xarray and pandas

Pull Request - State: open - Opened by peter-dudbridge 8 months ago

#169 - Fix bug in time convention application

Pull Request - State: open - Opened by peter-dudbridge 8 months ago - 1 comment

#168 - NaN values in relative humidity and vertical velocity

Issue - State: open - Opened by SauryChen 8 months ago

#167 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 8 months ago

#166 - Use a faster version of rankdata in CRPS. This is identical to the V1.13 scipy version with `method='ordinal'`

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#165 - Speed up CRPS for small ensemble sizes by looping rather than sorting. For M ensemble members, this is `O(M²)` compute and `O(M)` memory, which beats sorting for smaller M.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#164 - Speed up CRPS evaluation by caching spread computation (it sorts large arrays). This CL adds `@utils.dataset_safe_lru_cache`, which is similar to `functools.lru_cache`, but handles `xarray.Dataset` in addition to `Hashable`.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#163 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 9 months ago

#162 - era5/1959-2023_01_10-full_37-1h-1440x721.zarr cant be opened

Issue - State: open - Opened by markmbaum 9 months ago

#161 - ERA5 sea surface temperatures all NaN

Issue - State: open - Opened by markmbaum 9 months ago - 1 comment

#160 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 9 months ago

#159 - IFS HRES t=0 “Analysis” dataset total_precipitation_6hr parameter is always 0

Issue - State: open - Opened by agrigoriev 9 months ago

#158 - Allow NaN to propagate in EnsembleBrierScores and other Metrics. Previously, `NaN` forecasts ended up with a terrible Brier score. Now, they will get `NaN`. This happened for two reasons.

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#157 - Regional models not supported

Issue - State: open - Opened by sehoffmann 9 months ago

#157 - Regional models not supported

Issue - State: open - Opened by sehoffmann 9 months ago

#156 - Correct `DebiasedEnsembleBrierScore` docstring. Previously, the limiting (as ensemble size --> infinity) score was incorrect.

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#155 - Unit label incorrect for specific humidity plots

Issue - State: open - Opened by oliverwm1 9 months ago - 1 comment

#154 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 9 months ago

#153 - Use `Dataset.drop_vars` to implement `--drop_variables` flag in `slice_dataset.py`. This allows dropping of coordinates in addition to data vars.

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#152 - Use neuralGCM local output data as input gets error

Issue - State: open - Opened by weatherforecasterwhai 9 months ago - 1 comment

#151 - Bump jinja2 from 3.1.2 to 3.1.4 in /docs

Pull Request - State: closed - Opened by dependabot[bot] 10 months ago - 1 comment
Labels: dependencies

#150 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 10 months ago

#149 - Downloading data for one selected pressure level.

Issue - State: open - Opened by ChenyuDongNUS 10 months ago - 1 comment

#148 - Ran build_cleaner. Also some internal dependency changes.

Pull Request - State: open - Opened by copybara-service[bot] 10 months ago

#147 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 10 months ago