google-research/weatherbench2 issues and pull requests

#186 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 6 days ago

#185 - Clarify computation of accumulated precipitation in docstring and tests.

Pull Request - State: closed - Opened by copybara-service[bot] 6 days ago

#184 - RMSE scores on website differ from those on the corresponding Google Cloud dataset

Issue - State: open - Opened by cindyl983 12 days ago - 1 comment

#183 - Misc. fixes for newer versions of Xarray

Pull Request - State: closed - Opened by copybara-service[bot] 26 days ago

#182 - Misc. fixes for newer versions of Xarray

Pull Request - State: open - Opened by copybara-service[bot] 26 days ago

#181 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 26 days ago

#180 - * Allow `--variables` in `compute_ensemble_mean`

Pull Request - State: closed - Opened by copybara-service[bot] about 1 month ago

#179 - `resample_in_time` `BUGFIX`. Since the input dataset is modified (e.g. some variables dropped), some `input_chunks` will no longer be valid. This CL removes those dims from `input_chunks` to prevent missing dims errors.

Pull Request - State: closed - Opened by copybara-service[bot] about 1 month ago

#178 - Evaluate Persistence does not work

Issue - State: open - Opened by bar35643 about 2 months ago

#177 - What region is data stored in?

Issue - State: open - Opened by jrbourbeau about 2 months ago - 2 comments

#176 - BUGFIX `compute_zonal_energy_spectrum.py` so it uses `BASE_VARIABLES` to filter the `source` Dataset right from the start. This means the dimensions in (the filtered) `source` will be the same as in the output.

Pull Request - State: closed - Opened by copybara-service[bot] 2 months ago

#175 - [numpy] Fix users of NumPy APIs that are removed in NumPy 2.0.

Pull Request - State: closed - Opened by copybara-service[bot] 2 months ago

#174 - The production of the low resolution prediction results

Issue - State: open - Opened by rs-lsl 2 months ago - 3 comments

#173 - Possible bug with xarray dataset selection within beam

Issue - State: closed - Opened by jdwillard19 3 months ago - 2 comments

#172 - Possible bug in schema.apply_time_conventions (?)

Issue - State: open - Opened by timothyas 3 months ago

#171 - conservative regridding with land-sea mask

Issue - State: open - Opened by markmbaum 3 months ago

#170 - Allow later compatible versions of xarray and pandas

Pull Request - State: open - Opened by peter-dudbridge 3 months ago

#169 - Fix bug in time convention application

Pull Request - State: open - Opened by peter-dudbridge 3 months ago - 1 comment

#168 - NaN values in relative humidity and vertical velocity

Issue - State: open - Opened by SauryChen 3 months ago

#167 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago

#166 - Use a faster version of rankdata in CRPS. This is identical to the V1.13 scipy version with `method='ordinal'`

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#165 - Speed up CRPS for small ensemble sizes by looping rather than sorting. For M ensemble members, this is `O(M²)` compute and `O(M)` memory, which beats sorting for smaller M.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#164 - Speed up CRPS evaluation by caching spread computation (it sorts large arrays). This CL adds `@utils.dataset_safe_lru_cache`, which is similar to `functools.lru_cache`, but handles `xarray.Dataset` in addition to `Hashable`.

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago

#163 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago

#162 - era5/1959-2023_01_10-full_37-1h-1440x721.zarr cant be opened

Issue - State: open - Opened by markmbaum 4 months ago

#161 - ERA5 sea surface temperatures all NaN

Issue - State: open - Opened by markmbaum 4 months ago

#160 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago

#159 - IFS HRES t=0 “Analysis” dataset total_precipitation_6hr parameter is always 0

Issue - State: open - Opened by agrigoriev 4 months ago

#158 - Allow NaN to propagate in EnsembleBrierScores and other Metrics. Previously, `NaN` forecasts ended up with a terrible Brier score. Now, they will get `NaN`. This happened for two reasons.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#157 - Regional models not supported

Issue - State: open - Opened by sehoffmann 5 months ago

#157 - Regional models not supported

Issue - State: open - Opened by sehoffmann 5 months ago

#156 - Correct `DebiasedEnsembleBrierScore` docstring. Previously, the limiting (as ensemble size --> infinity) score was incorrect.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#155 - Unit label incorrect for specific humidity plots

Issue - State: open - Opened by oliverwm1 5 months ago - 1 comment

#154 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#153 - Use `Dataset.drop_vars` to implement `--drop_variables` flag in `slice_dataset.py`. This allows dropping of coordinates in addition to data vars.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#152 - Use neuralGCM local output data as input gets error

Issue - State: open - Opened by weatherforecasterwhai 5 months ago - 1 comment

#151 - Bump jinja2 from 3.1.2 to 3.1.4 in /docs

Pull Request - State: open - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#150 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#149 - Downloading data for one selected pressure level.

Issue - State: open - Opened by ChenyuDongNUS 5 months ago - 1 comment

#148 - Ran build_cleaner. Also some internal dependency changes.

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#147 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#146 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#145 - Add `--num_threads` flag to weatherbench scripts. Added to all `DatasetToChunks` or `ChunksToZarr` call. Previously, some scripts had it and some didn't. Sometimes `num_threads=16` was hardcoded.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#144 - Require `--quantiles` set if `'quantile' in --stats`. This prevents a mysterious `ZeroDivisionError`.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#143 - Adjust windows so that `method=resample` and `method=rolling` align. Also set `skipna=False` when computing statistics. This is anticipation of the following development workflow:

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#143 - Adjust windows so that `method=resample` and `method=rolling` align. Also set `skipna=False` when computing statistics. This is anticipation of the following development workflow:

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#142 - BUGFIX: Remove hard-coded time dimension in `resample_in_time.py`. Previously, we used `TIME_DIM.value` in some places, and `time` in others.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#141 - `slice_dataset.py` added to `weatherbench2/scripts/`. This writes a new dataset that is a slice of the old one.

Pull Request - State: open - Opened by copybara-service[bot] 5 months ago

#141 - `slice_dataset.py` added to `weatherbench2/scripts/`. This writes a new dataset that is a slice of the old one.

Pull Request - State: closed - Opened by copybara-service[bot] 5 months ago

#140 - Flexible time resampling added in `resample_in_time.py`.

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#139 - Fix URLs for Keisler data

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#138 - Run build_cleaner on weatherbench2/scripts

Pull Request - State: open - Opened by copybara-service[bot] 6 months ago

#137 - Use `datetime64[ns]` dtypes rather than `datetime64[D]`. Day resolution is not fully supported in Xarray. See https://github.com/pydata/xarray/issues/7493

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#136 - Incorrect paths for Keisler

Issue - State: closed - Opened by hyunju-jung 6 months ago - 1 comment

#135 - xbeam.open_zarr()` fails to open stores that `xarray.open_zarr()` handles fine with chunking

Issue - State: open - Opened by jdwillard19 6 months ago - 3 comments

#134 - Missing `absl-py` dependency

Issue - State: open - Opened by sehoffmann 6 months ago

#134 - Missing `absl-py` dependency

Issue - State: open - Opened by sehoffmann 6 months ago

#133 - _decode_pressure_level_suffixes() does not run lazily, gives out-of-memory errors

Issue - State: open - Opened by jdwillard19 6 months ago - 1 comment

#132 - Improve `DebiasedEnsembleBrierScoreTest` by showing that, before debiasing, the anticipated bias is equal to the observed bias.

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#132 - Improve `DebiasedEnsembleBrierScoreTest` by showing that, before debiasing, the anticipated bias is equal to the observed bias.

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#131 - Fix pytype issue with using `|` rather than `typing.Union` in WB2. This will allow WB2 to work in Python 3.9, which is open source colab.

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#130 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 6 months ago

#129 - Add debiased scores: `DebiasedEnsembleMeanMSE`, `DebiasedSpatialEnsembleMeanMSE`, and `DebiasedEnsembleBrierScore` to weatherbench. These remove bias by subtracting `SampleVariance / EnsembleSize` before time/space averaging. Docstrings updated to make bias implications clear.

Pull Request - State: open - Opened by copybara-service[bot] 7 months ago

#129 - Add debiased scores: `DebiasedEnsembleMeanMSE`, `DebiasedSpatialEnsembleMeanMSE`, and `DebiasedEnsembleBrierScore` to weatherbench. These remove bias by subtracting `SampleVariance / EnsembleSize` before time/space averaging. Docstrings updated to make bias implications clear.

Pull Request - State: closed - Opened by copybara-service[bot] 7 months ago

#128 - Add remark about finite sample bias to `EnsembleBrierScore`

Pull Request - State: closed - Opened by copybara-service[bot] 7 months ago

#127 - Evaluate.py issues, '.zmetadata' not found

Issue - State: open - Opened by jdwillard19 7 months ago - 5 comments

#126 - WeatherBench2 Evaluation Quickstart Runtime

Issue - State: open - Opened by adominious 7 months ago - 1 comment

#125 - feat: adding Africa region

Pull Request - State: open - Opened by greysab 7 months ago - 2 comments

#124 - Mean radiation fluxes contain NaNs

Issue - State: open - Opened by Arcomano1234 7 months ago - 1 comment

#123 - Support calculation of metrics (s.a. RMSE) for each grid point

Issue - State: closed - Opened by LevanBokeria 8 months ago - 1 comment

#122 - [weatherbench2] Add Threshold classes, implement GaussianQuantileThreshold in Gaussian metrics.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#121 - [weatherbench2] Add Brier and ignorance scores to gaussian evaluation script.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#120 - [weatherbench2] Add Gaussian ignorance score.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#119 - [weatherbench2] Add Gaussian Brier score.

Pull Request - State: closed - Opened by copybara-service[bot] 8 months ago

#118 - Fixed NeuralGCM path

Pull Request - State: closed - Opened by raspstephan 8 months ago
Labels: pull ready

#118 - Fixed NeuralGCM path

Pull Request - State: closed - Opened by raspstephan 8 months ago
Labels: pull ready

#117 - Added GraphCast to data guide

Pull Request - State: closed - Opened by raspstephan 8 months ago
Labels: pull ready

#116 - Support weather station evaluation

Issue - State: open - Opened by raspstephan 8 months ago

#115 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 8 months ago - 1 comment

#114 - Add NeuralGCM to data guide and update paths

Pull Request - State: closed - Opened by raspstephan 9 months ago
Labels: pull ready

#113 - Bump jinja2 from 3.1.2 to 3.1.3 in /docs

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 1 comment
Labels: dependencies

#112 - [weatherbench2] Add Gaussian flag to evaluation script.

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#111 - [weatherbench2] Add auxiliary variables to config.Selection.

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#110 - graphcast missing in dataset

Issue - State: closed - Opened by akhtarvision 9 months ago - 8 comments

#109 - [weatherbench2] Test analytical Gaussian CRPS.

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#108 - [weatherbench2] Add GaussianVariance metric.

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#107 - Are there plans to support the spatial resolution of 2.8125°, and 1.40625°?

Issue - State: open - Opened by CaradryanLiang 10 months ago - 1 comment

#106 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#105 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago - 1 comment

#104 - About the forcast result in the dataset

Issue - State: closed - Opened by rs-lsl 10 months ago - 4 comments

#103 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#102 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#101 - Give better error message in weatherbench/metrics when climatology doesn't contain forecast keys. Previously, the KeyError raised by xr would indicate that "some_var_mean" was not found, but that "_mean" variable was likely just a "let's do a final attempt" at finding variables, and this confuses the user.

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#100 - The forecast dataset path in the evaluation.ipynb quick setup guide seems to be wrong

Issue - State: closed - Opened by LevanBokeria 10 months ago - 2 comments

#99 - Issue with setup.py in Dataflow

Issue - State: open - Opened by raspstephan 10 months ago - 2 comments

#98 - No public description

Pull Request - State: open - Opened by copybara-service[bot] 10 months ago

#98 - No public description

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

GitHub / google-research/weatherbench2 issues and pull requests