/

Running your first job

How to configure and run your first job.


Introduction

This guide assumes that you created a workflow and added data and/or processing blocks. For more details, please go to Building your first workflow. The next step is generating the outputs defined by the workflow. To do this, users have to configure and run a job. The expected output is a ship detection map in the harbour of Leixões (Portugal) using SPOT satellite images.

Configure job

1] Now that the workflow is created, it needs to be run as a job. To continue, click on Save & Configure Job.

step15 saveAndConfigureJob

2] You will be redirected to the job configuration window. In this window, you can draw the Area of Interest (AOI), select the Geometric Filter (bounding box, intersects or contains) and adjust the parameters in JavaScript Object Notation (JSON) format. On the left side, you can adjust various parameters, such as the time or the limit. On the lower left side, the price estimation is displayed (for more information, proceed to step 12).

step16 jobConfig price overview

The coordinates of the AOI can also be pasted from other sources as a GeoJSON geometry. We recommend using the online GIS tool GeoJSON.io.

GeoJSON geometry

In this example, the following job parameters were used:

{
"oneatlas-spot-aoiclipped:1": {
"ids": null,
"time": "2018-01-01T00:00:00+00:00/2020-12-31T23:59:59+00:00",
"limit": 1,
"zoom_level": 17,
"time_series": null,
"max_cloud_cover": 10,
"panchromatic_band": false,
"intersects": {
  "type": "Polygon",
  "coordinates": [
      [
        [
          -8.721771,
          41.190281
        ],
        [
          -8.685722,
          41.191573
        ],
        [
          -8.684349,
          41.17271
        ],
        [
          -8.720398,
          41.169351
        ],
        [
          -8.721771,
          41.190281
        ]
      ]
    ]
  }
  },
"tiling:1": {
 "nodata": null,
 "tile_width": 768,
 "tile_height": 768,
 "match_extents": true,
 "output_prefix": "",
 "augmentation_factor": 1,
 "discard_empty_tiles": true
},
"ship-detection:1": {}

If the limit is set to 1, the most recent image is returned by default. For a limit value greater than 1, the images are returned by descending chronological order (i.e. from most recent to least recent).

Price estimation

3] Depending on the size of the AOI and the parameters you previously adjusted, the total price is estimated in the lower left side of the job configuration window. It is recommended to scroll down, in order to view the total estimated price.

step16 jobConfig price zoom

In this example, the UP42 credits which will be consumed range between 4103 and 5359 (the equivalent of approximately 50 euro). If your UP42 credit balance is not sufficient, you can reduce the size of the AOI or tweak the job parameters. The price estimation will change in real time.

Run job

4] After drawing the AOI and configuring the parameters, you can run the job in two ways:

  • check image availability by first running a Test Query and then running a Live Job (also defined as Real Job)
  • run a Live Job

4.1] Test Query

If you first run a Test Query, this will query for available images for your selected area and parameters, which will not consume credits. Only the quicklooks and metadata of the available images are generated. To access this information, follow the steps below:

step18 runTestQuery

  • In order to view the quicklooks and have a general idea of the cloud cover and image availability, click on Quick Looks. Please note that quicklooks are a low-resolution version of the original images. If you have more quicklooks, you can scroll from left to right and view each quicklook individually.

step19 quicklooks

step20 viewQuicklooks

  • In order to view the metadata and have a general idea of the acquisition date, snow cover, sensor type etc., click on Preview.

step21 preview

step22 viewPreview

4.2] Live Job

If you are satisfied with the quicklooks and metadata, you can run a Live Job by clicking on Run as real job. For more information, proceed to step 13.

A Live Job consumes credits. We recommend first running a Test Query and making sure the job parameters are correctly set.

step23 runRealJob

5] If you wish to skip the Test Query and proceed with directly generating the geospatial outputs, launch a Live Job (also defined as Real Job). This will consume credits and generate the following outputs:

  • the SPOT satellite image(s) from the SPOT 6/7 Display (Streaming) data block. Streamed images are only used as a basis for applying algorithms and cannot be downloaded. For downloading SPOT images, please use the data blocks [SPOT 6/7 Display (Download)](/blocks/data/oneatlas-spot-display) or SPOT 6/7 Reflectance (Download)
  • the SPOT image tiles from the Raster Tiling processing block
  • the ships from the Ship Detection processing block

step17 runLiveJob

6] The job status is displayed in grey as Running.

step24 jobPending

The Jobs window displays the job status and metadata, as well as multiple actions to perform:

ActionDescription
Rerun JobRepeats a job that is running or has finished.
Cancel JobCancels a job that is running.
Job ProgressDisplays a log of the running job and the status for each steps.
ParametersDisplays the job parameters in JSON format.

In the Job progress, each step name corresponds to a block in the workflow and it is defined as a task. Clicking on each of these names will display the task overview page and the logs for that task.

7] When the job run is finalized, the status is displayed in green as Successful:

step25 jobFinished

Download job results

8] Once the job run is finished, you can download the outputs in more ways:

8.1] Last Output

If you want to access the output from the last block, click on Download.

8.2] Intermediate Outputs

If you want to access each individual output from each block, click on Results.

step26 downloadLastResult

9] The outputs will be downloaded by default in the folder Downloads as TAR archives. The TAR archives need to be unzipped. For Windows OS, it is recommended to unpack them with third-party tools. For more information, please read this article: How to unpack a tar file in Windows.

step29 unzipTarball

10] Once the TAR archives are unpacked, you will have a collection of results stored in folders named output. After opening the contents of these folders, various files will be displayed. Please note that the outputs are available in either raster or vector file formats.

step30 checkOutput

step30 checkOutput2

step30 checkOutput3

Visualize job results

11] UP42 does not support the visualization of these geospatial results. It is recommended to download the free GIS software QGIS, where you can display and further analyze the results. For this example, the results are displayed in the sections below.

Tiled SPOT image

spot tiling

Detected ships overlayed on the SPOT image

spot image overlayed ships

Congratulations, you successfully configured and ran a job of your first workflow!