/

Export data (Raster)

Exports the raster output generated from data or processing blocks to a GCS/AWS bucket.


Introduction

For more information, please read the block description.

Block type: PROCESSING

This block enables exporting the raster output generated from data or processing blocks from an UP42 workflow to a Google Cloud Storage (GCS) or Amazon Web Services (AWS) bucket. The full content of the output is copied to the bucket. The user can optionally provide a prefix for an output directory within the bucket.

In order to access the bucket, the access credentials need to be provided via UP42 environment variables. For AWS, provide the AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY as environment variables. No bucket region setting is required. For GCS, provide the full json string of the Google Application Credentials json as the GOOGLE_KEY_STRING environment variable. Example:

Environment variables
Environment variables

Supported parameters

For more information, please read the section Data source query filters.

  • cloud_provider: The cloud storage provider of the bucket, either gcs or aws.

  • bucket_name: The bucket name.

  • prefix: A file structure prefix to limit the dataset search to a specific subdirectory. Conforms to the gcs & aws prefix structure, which excludes the bucket name. E.g. folder1/folder2/.

Example parameters

Example for exporting Sentinel-2 raster data to a GCS bucket using a prefix:

{
    "sobloo-s2-l1c-fullscene:1":
        {
            "ids": ["S2A_MSIL1C_20190524T101031_N0207_R022_T32UQD_20190524T111235"]
        }
    "export-data:1": {
        "cloud_provider": "gcs",
        "bucket_name": "sentinel-2-data",
        "prefix": "europe/france/"
    }
}

Output format

The output data.json is a copy from the exported result.