Introduction
For more information, please read the block description.
Block type: DATA
This block imports external GeoJSON vector data from a Google Cloud Storage (GCS) or Amazon Web Services (AWS) bucket into UP42 for further processing using workflows.
Within the bucket, the user can select specific images (via the filenames) or search by location and date. The search can also be limited to a subfolder in the bucket via the prefix
parameter. The block outputs the vector data and an automatically created data.json
file with the vector metadata.
In order to access the bucket, the access credentials need to be provided via UP42 environment variables. For AWS, provide the AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY as environment variables. No bucket region setting is required. For GCS, provide the full json string of the Google Application Credentials json as the GOOGLE_KEY_STRING
environment variable.
Supported parameters
For more information, please read the section JSON Parameters.
cloud_provider
: The cloud storage provider of the bucket, eithergcs
oraws
.bucket_name
: The bucket name.prefix
: A file structure prefix to limit the dataset search to a specific subdirectory. Conforms to the gcs & aws prefix structure, which excludes the bucket name. E.g.folder1/folder2/
.filenames
: An array of GeoJSON filenames, including suffix. Thefilenames
filter overrides all other filters, e.g.,intersects
,limit
and/ortime
.bbox
: The bounding box to use as an AOI. Will return all scenes that intersect with this box. Use onlybox
orintersects
.intersects
: A GeoJSON geometry to use as an AOI. Will return all scenes that intersect with this geometry. Use onlyintersects
orbbox
.contains
: A GeoJSON geometry to use as an AOI. Will return all scenes that completely cover this geometry. Use onlycontains
orintersects
orbbox
.limit
: An integer number of maximum results to return. Omit this to set no limit.
Example queries
GCS query
Example query with GCS, using filenames
and prefix
:
{
"up42-import-geojson:1": {
"cloud_provider": "gcs",
"bucket_name": "blocks-e2e-testing",
"prefix": "e2e_import_geojson",
"filenames": [""highway_2020-12-03T14_20_03Z.geojson""],
"intersects": null,
"limit": 1
}
}
AWS query
Example query with AWS, searching via aoi
.
{
"up42-import-geojson:1": {
"cloud_provider": "aws",
"bucket_name": "blocks-e2e-testing",
"prefix": null,
"filenames": null,
"bbox": [13.351818, 52.501907, 13.379109, 52.510788],
"limit": 4
}
}
Output format
The output GeoJSON contains the GeoJSON file metadata, with the up42.data_path
pointing to the GeoJSON file.
{
"type": "FeatureCollection",
"features": [
{
"type": "Feature",
"id": "0",
"geometry": {
"type": "Polygon",
"coordinates": [
[
[
13.428595,
52.486969
],
[
13.428595,
52.527166
],
[
13.386982,
52.527166
],
[
13.386982,
52.486969
],
[
13.428595,
52.486969
]
]
]
},
"properties": {
"out_file": "/tmp/output/highway_2020-12-03T14_20_03Z.geojson",
"up42.data_path": "highway_2020-12-03T14_20_03Z.geojson",
"url": "gs://blocks-e2e-testing/e2e_import_geojson/highway_2020-12-03T14_20_03Z.geojson"
}
}
]
}
Capabilities
Output
vector
up42_standard | |
---|---|
format | GeoJSON |
geometry_type | {
"or": [
"MultiPoint",
"MultiLinestring",
"MultiPolygon",
"Polygon",
"Linestring",
"Point"
]
} |