Introduction
For more information, please read the block description.
Block type: PROCESSING
This block enables exporting the raster output generated from data or processing blocks from an UP42 workflow to a Google Cloud Storage (GCS) or Amazon Web Services (AWS) bucket. The full content of the output is copied to the bucket. The user can optionally provide a prefix for an output directory within the bucket.
In order to access the bucket, the access credentials need to be provided via UP42 environment variables. For AWS, provide the AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY as environment variables. No bucket region setting is required. For GCS, provide the full json string of the Google Application Credentials json as the GOOGLE_KEY_STRING environment variable. Example:
Supported parameters
For more information, please read the section JSON parameters.
cloud_provider: The cloud storage provider of the bucket, eithergcsoraws.bucket_name: The bucket name.prefix: A file structure prefix to limit the dataset search to a specific subdirectory. Conforms to the gcs & aws prefix structure, which excludes the bucket name. E.g. folder1/folder2/.
Example parameters
Example for exporting Sentinel-2 raster data to a GCS bucket using a prefix:
{
"sobloo-s2-l1c-fullscene:1":
{
"ids": ["S2A_MSIL1C_20190524T101031_N0207_R022_T32UQD_20190524T111235"]
}
"export-data:1": {
"cloud_provider": "gcs",
"bucket_name": "sentinel-2-data",
"prefix": "europe/france/"
}
}Output format
The output data.json is a copy from the exported result.
Capabilities
Input
raster
| up42_standard | |
|---|---|
format | {
"or": [
"GTiff",
"SAFE",
"DIMAP",
"NetCDF"
]
} |