Datasets

CloudDrift provides convenience functions to access real-world ragged-array datasets.

>>> from clouddrift.datasets import gdp1h
>>> ds = gdp1h()
    <xarray.Dataset>
    Dimensions:                (traj: 17324, obs: 165754333)
    Coordinates:
        ids                    (obs) int64 ...
        lat                    (obs) float32 ...
        lon                    (obs) float32 ...
        time                   (obs) datetime64[ns] ...
    Dimensions without coordinates: traj, obs
    Data variables: (12/55)
        BuoyTypeManufacturer   (traj) |S20 ...
        BuoyTypeSensorArray    (traj) |S20 ...
        CurrentProgram         (traj) float64 ...
        DeployingCountry       (traj) |S20 ...
        DeployingShip          (traj) |S20 ...
        DeploymentComments     (traj) |S20 ...
        ...                     ...
        sst1                   (obs) float64 ...
        sst2                   (obs) float64 ...
        typebuoy               (traj) |S10 ...
        typedeath              (traj) int8 ...
        ve                     (obs) float32 ...
        vn                     (obs) float32 ...
    Attributes: (12/16)
        Conventions:       CF-1.6
        acknowledgement:   Elipot, Shane; Sykulski, Adam; Lumpkin, Rick; Centurio...
        contributor_name:  NOAA Global Drifter Program
        contributor_role:  Data Acquisition Center
        date_created:      2022-12-09T06:02:29.684949
        doi:               10.25921/x46c-3620
        ...                ...
        processing_level:  Level 2 QC by GDP drifter DAC
        publisher_email:   aoml.dftr@noaa.gov
        publisher_name:    GDP Drifter DAC
        publisher_url:     https://www.aoml.noaa.gov/phod/gdp
        summary:           Global Drifter Program hourly data
        title:             Global Drifter Program hourly drifting buoy collection

Currently available datasets are:

• clouddrift.datasets.andro(): The ANDRO dataset as a ragged array processed from the upstream dataset hosted at the SEANOE repository.

• clouddrift.datasets.gdp1h(): 1-hourly Global Drifter Program (GDP) data from a cloud-optimized Zarr dataset on AWS.

• clouddrift.datasets.gdp6h(): 6-hourly GDP data from a ragged-array NetCDF file hosted by the public HTTPS server at NOAA’s Atlantic Oceanographic and Meteorological Laboratory (AOML).

• clouddrift.datasets.glad(): 15-minute Grand LAgrangian Deployment (GLAD) data produced by the Consortium for Advanced Research on Transport of Hydrocarbon in the Environment (CARTHE) and hosted upstream at the Gulf of Mexico Research Initiative Information and Data Cooperative (GRIIDC).

• clouddrift.datasets.mosaic(): MOSAiC sea-ice drift dataset as a ragged array processed from the upstream dataset hosted at the NSF’s Arctic Data Center.

• clouddrift.datasets.subsurface_floats(): The subsurface float trajectories dataset as hosted by NOAA AOML at NOAA’s Atlantic Oceanographic and Meteorological Laboratory (AOML) <https://www.aoml.noaa.gov/phod/float_traj/index.php>_ and maintained by Andree Ramsey and Heather Furey from the Woods Hole Oceanographic Institution.

• clouddrift.datasets.spotters(): The Sofar Ocean Spotters archive dataset as hosted at the public AWS S3 bucket.

• clouddrift.datasets.yomaha(): The YoMaHa’07 dataset as a ragged array processed from the upstream dataset hosted at the Asia-Pacific Data-Research Center (APDRC).

• clouddrift.datasets.hurdat2(): The HURricane DATa 2nd generation (HURDAT2) processed from the upstream dataset hosted at the NOAA AOML Hurricane Research Devision.

The GDP and the Spotters datasets are accessed lazily, so the data is only downloaded when specific array values are referenced. The ANDRO, GLAD, MOSAiC, Subsurface Floats, and YoMaHa’07 datasets are downloaded in their entirety when the function is called for the first time and stored locally for later use.