... | @@ -20,13 +20,12 @@ when comparing variables from ICOADS (See the [list of ICOADS variables](https:/ |
... | @@ -20,13 +20,12 @@ when comparing variables from ICOADS (See the [list of ICOADS variables](https:/ |
|
**Processing stages**
|
|
**Processing stages**
|
|
--------------------
|
|
--------------------
|
|
|
|
|
|
The following diagram is a summary of the data processing workflow follow by
|
|
The diagram below is a summary of the data processing workflow followed by
|
|
the shell scripts defined in ```scr```. Each block
|
|
the shell scripts defined in ```scr```. Each block
|
|
represents a main task done by one script in```rscripts```.
|
|
represents a main task done by one script in```rscripts```.
|
|
The corresponding `.R` file name is highlight in grey between each stage
|
|
The corresponding `.R` file name has been added in grey between each block. For more information on eah `.R` script, please see look at [API reference page.](api-reference)
|
|
(For more information on eah `.R` script, please see the [API-reference](api-reference))
|
|
|
|
|
|
|
|
Orange blocks represent pre-processing tasks done to the ICOADS data,
|
|
- Orange blocks represent pre-processing tasks done to the ICOADS data,
|
|
in order to:
|
|
in order to:
|
|
|
|
|
|
1. Select data taken only by commercial ships, excluding
|
|
1. Select data taken only by commercial ships, excluding
|
... | @@ -37,7 +36,7 @@ identification and linking of `id`'s between each pair of duplicate reports. |
... | @@ -37,7 +36,7 @@ identification and linking of `id`'s between each pair of duplicate reports. |
|
3. Preformed [quality control](Workflow/quality-control) on the data to point
|
|
3. Preformed [quality control](Workflow/quality-control) on the data to point
|
|
out the best duplicate.
|
|
out the best duplicate.
|
|
|
|
|
|
The rest of the blocks represent processing scripts that concentrate in the duplicates
|
|
- The rest of the blocks represent processing scripts that concentrate in the duplicates
|
|
identification and [matching of reports ID's](Workflow/matching-criteria).
|
|
identification and [matching of reports ID's](Workflow/matching-criteria).
|
|
|
|
|
|
```mermaid
|
|
```mermaid
|
... | | ... | |