|
|
|
|
|
|
|
**Data input**
|
|
|
|
--------------
|
|
|
|
The following data is require by the scripts of this repository:
|
|
|
|
The following data is required by the scripts of this repository:
|
|
|
|
|
|
|
|
- [ICOADS v3.0](https://icoads.noaa.gov/r3.html). [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
|
|
|
|
- Metadata from WMO Publication 47.
|
| ... | ... | @@ -10,9 +10,9 @@ The following data is require by the scripts of this repository: |
|
|
|
- Inventory of ship names in the
|
|
|
|
[US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out)
|
|
|
|
- generate_id (**needs description**)
|
|
|
|
- **Precision criteria file**. An estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
|
|
|
|
year and or SID. This precision criteria is require in order to set tolerances
|
|
|
|
when comparing variables from ICOADS. Comparison of variables allows for
|
|
|
|
- **Precision criteria file**. An estimate of the precision of each key variable (e.g. `sst, lat, lon`) per `dck`,
|
|
|
|
`yr` and or `sid`. This precision criteria is require in order to set tolerances
|
|
|
|
when comparing variables from ICOADS (See the [list of ICOADS variables](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/wikis/API-Reference#icoads-variables-used) used in this repository). Comparison of variables allows for
|
|
|
|
a match between reports in the duplicate identification procedure.
|
|
|
|
- **Json files** containing ITU callsign prefixes associated with a country.
|
|
|
|
- **seq IDS.** (**needs description**)
|
| ... | ... | @@ -26,19 +26,19 @@ represents a main task done by one script in```rscripts```. |
|
|
|
The corresponding `.R` file name is highlight in grey between each stage
|
|
|
|
(For more information on eah `.R` script, please see the [API-reference](api-reference))
|
|
|
|
|
|
|
|
Orange blocks represent pre-processing tasks done to the ICOADS data base,
|
|
|
|
Orange blocks represent pre-processing tasks done to the ICOADS data,
|
|
|
|
in order to:
|
|
|
|
|
|
|
|
1. Select data taken only by commercial ships, excluding
|
|
|
|
specialist ship data sources, such as research vessels
|
|
|
|
(For more information see the [selection criteria](Workflow/data-selection)).
|
|
|
|
2. [Preprocessing of IDs](Workflow/processing-of-ids) to improve duplicate
|
|
|
|
identification and linking of IDs between each pair of duplicate reports.
|
|
|
|
2. [Preprocessing of ID's](Workflow/processing-of-ids) to improve duplicate
|
|
|
|
identification and linking of `id`'s between each pair of duplicate reports.
|
|
|
|
3. Preformed [quality control](Workflow/quality-control) on the data to point
|
|
|
|
out the best duplicate.
|
|
|
|
|
|
|
|
The rest of the blocks represent processing scripts that concentrate in the duplicates
|
|
|
|
identification and [matching of reports IDs](Workflow/matching-criteria).
|
|
|
|
identification and [matching of reports ID's](Workflow/matching-criteria).
|
|
|
|
|
|
|
|
```mermaid
|
|
|
|
graph TB
|
| ... | ... | |
