Running your first job

Introduction

This guide assumes that you created a workflow and added data and/or processing blocks. For more details, please go to Building your first workflow. The next step is generating the outputs defined by the workflow. To do this, users have to configure and run a job. The expected output is a ship detection map in the harbour of Leixões (Portugal) using SPOT satellite images.

Configure job

1] Now that the workflow is created, it needs to be run as a job. To continue, click on Save & Configure Job.

2] You will be redirected to the job configuration window. In this window, you can draw the Area of Interest (AOI), select the Geometric Filter (bounding box, intersects or contains) and adjust the parameters in JavaScript Object Notation (JSON) format. On the left side, you can adjust various parameters, such as the time or the limit. On the lower left side, the price estimation is displayed (for more information, proceed to step 12).

In this example, the following job parameters were used:

{
"oneatlas-spot-aoiclipped:1": {
"ids": null,
"time": "2018-01-01T00:00:00+00:00/2020-12-31T23:59:59+00:00",
"limit": 1,
"zoom_level": 17,
"time_series": null,
"max_cloud_cover": 10,
"panchromatic_band": false,
"intersects": {
  "type": "Polygon",
  "coordinates": [
      [
        [
          -8.721771,
          41.190281
        ],
        [
          -8.685722,
          41.191573
        ],
        [
          -8.684349,
          41.17271
        ],
        [
          -8.720398,
          41.169351
        ],
        [
          -8.721771,
          41.190281
        ]
      ]
    ]
  }
  },
"tiling:1": {
 "nodata": null,
 "tile_width": 768,
 "tile_height": 768,
 "match_extents": true,
 "output_prefix": "",
 "augmentation_factor": 1,
 "discard_empty_tiles": true
},
"ship-detection:1": {}

Price estimation

3] Depending on the size of the AOI and the parameters you previously adjusted, the total price is estimated in the lower left side of the job configuration window. It is recommended to scroll down, in order to view the total estimated price.

Run job

4] After drawing the AOI and configuring the parameters, you can run the job in two ways:

• check image availability by first running a Test Query and then running a Live Job (also defined as Real Job)
• run a Live Job

4.1] Test Query

If you first run a Test Query, this will query for available images for your selected area and parameters, which will not consume credits. Only the quicklooks and metadata of the available images are generated. To access this information, follow the steps below:

• In order to view the quicklooks and have a general idea of the cloud cover and image availability, click on Quick Looks. Please note that quicklooks are a low-resolution version of the original images. If you have more quicklooks, you can scroll from left to right and view each quicklook individually.

• In order to view the metadata and have a general idea of the acquisition date, snow cover, sensor type etc., click on Preview.

4.2] Live Job

If you are satisfied with the quicklooks and metadata, you can run a Live Job by clicking on Run as real job. For more information, proceed to step 13.

5] If you wish to skip the Test Query and proceed with directly generating the geospatial outputs, launch a Live Job (also defined as Real Job). This will consume credits and generate the following outputs:

• the SPOT satellite image(s) from the SPOT 6/7 Display (Streaming) data block. Streamed images are only used as a basis for applying algorithms and cannot be downloaded. For downloading SPOT images, please use the data blocks [SPOT 6/7 Display (Download)](/blocks/data/oneatlas-spot-display) or SPOT 6/7 Reflectance (Download)
• the SPOT image tiles from the Raster Tiling processing block
• the ships from the Ship Detection processing block

6] The job status is displayed in grey as Running.

In the Job progress, each step name corresponds to a block in the workflow and it is defined as a task. Clicking on each of these names will display the task overview page and the logs for that task.

7] When the job run is finalized, the status is displayed in green as Successful:

Download job results

8] Once the job run is finished, you can download the outputs in more ways:

8.1] Last Output

If you want to access the output from the last block, click on Download.

8.2] Intermediate Outputs

If you want to access each individual output from each block, click on Results.

9] The outputs will be downloaded by default in the folder Downloads as TAR archives. The TAR archives need to be unzipped. For Windows OS, it is recommended to unpack them with third-party tools. For more information, please read this article: How to unpack a tar file in Windows.

10] Once the TAR archives are unpacked, you will have a collection of results stored in folders named output. After opening the contents of these folders, various files will be displayed. Please note that the outputs are available in either raster or vector file formats.

Visualize job results

11] UP42 does not support the visualization of these geospatial results. It is recommended to download the free GIS software QGIS, where you can display and further analyze the results. For this example, the results are displayed in the sections below.

Tiled SPOT image

Detected ships overlayed on the SPOT image

Congratulations, you successfully configured and ran a job of your first workflow!