History#

v0.4.0 (2023-03-30)#

Contributors to this version: Trevor James Smith (@Zeitsperre), Pascal Bourgault (@aulemahal), Travis Logan (@tlogan2000).

New features#

  • Improvements have been made to the development documentation; Project URLs, ReadTheDocs theming, and other quality of life changes.

  • Conversion JSON definitions now support pre-processing to render dimensions and variable names consistent before running corrections/conversions.

  • New datasets with CF-like attributes conversion supported:

    • RDRS (ECCC)

    • GRNCH (ETS)

  • Preliminary miranda.io module for organizing output-writing functionality.

  • New miranda.io.fetch_chunk_config function for “rechunking” datasets according to project presets.

  • New mirands.io.utils.name_output_file for generating names from Dataset facets or from a dictionary.

  • New mirands.gis.subset_domain for clipping dataset to a preconfigured region.

Bug fixes#

  • Many data-related utilities now have more accurate static typing.

  • Converted dataset global attributes are now synchronized for consistency.

  • ECMWF-based datasets now implement more consistent conversion factors and metadata.

  • miranda.storage.file_size now handles dictionaries of Pathlib objects.

Internal changes#

  • Pre-commit version updates.

  • Improvements have been made to the development documentation; Project URLs, ReadTheDocs theming, installation methods, and other quality of life changes.

  • Schema and folder structure updates:

    • gridded-obs -> reconstruction

    • bias-adjust-project is used when present and not just when level==”biasadjusted”

  • CI now using tox>=4.0 and ubuntu-latest virtual machine images.

v0.3.0 (2022-11-24)#

Contributors to this version: Trevor James Smith (@Zeitsperre), Pascal Bourgault (@aulemahal), David Huard (@huard), Travis Logan (@tlogan2000), Gabriel Rondeau-Genesse (@RondeauG), and Sébastien Biner (@sbiner).

Announcements#

  • First public release on PyPI.

New features#

  • Dataset conversion tools (miranda.convert) use a JSON-definition file to dynamically populate metadata, run data quality checks, and convert units to CF-compliant standard. Supported datasets are:

    • ERA5/ERA5-Land (complete)

    • MELCC (stations) (beta)

    • ECCC (stations) (alpha)

    • NASA DayMet (WIP)

    • NASA AgMerra/AgCFSR (WIP)

    • Hydro Québec (stations) (WIP)

    • DEH (stations) (WIP)

    • WFDEI-GEM-CAPA (WIP)

  • Module (miranda.eccc) for ECCC station data and ECCC Adjusted and Homogenized Canadian Climate Data (AHCCD) conversion (WIP).

  • Module (miranda.ncar) for fetching interpolated CORDEX-NAM (22i/44i) from NCAR AWS data storage.

  • Module (miranda.ecmwf) for fetching ECMWF ERA5/-Land (single-levels, pressure-levels, monthly-means) datasets via CDSAPI.

  • Module (miranda.gis) for setting specific subsetting domains used when converting gridded datasets.

  • Modules (miranda.archive and miranda.remote) for performing data archiving actions locally and remotely (powered by fabric and paramiko) (WIP).

  • Module (miranda.decode) for ingesting and parsing dataset metadata based on filename and dataset attributes. Supported datasets are:

    • miranda converted datasets

    • CMIP6

    • CMIP5

    • CMIP5-CORDEX

    • ISIMIP-FT

    • CanDCS-U6 (PCIC)

  • Module (miranda.structure) for create constructing file-tree databases based on YAML-defined metadata schemas (WIP).

  • Modules (miranda.cv and miranda.validators) for validating metadata using ESGF controlled vocabularies (taken from pyessv-archive) and schema definitions (powered by schema), respectively (WIP).