| ... | ... | @@ -13,19 +13,16 @@ A precision criteria on selected variables is used to perform a |
|
|
|
climatological quality control on the data.
|
|
|
|
|
|
|
|
The precision criteria for each key variable per `dck`,
|
|
|
|
year and/or `sid` can be found [here]() (**Need to add a link to the prec_file**).
|
|
|
|
year and/or `sid` can be found in Table 5 of the [technical report]().
|
|
|
|
|
|
|
|
Having a precision criteria not only preforms quality control on the data but helps to set tolerances when comparing variables from suspected duplicates.
|
|
|
|
|
|
|
|
A comparison of climatological variables allows for a match between reports in the duplicate identification procedure.
|
|
|
|
|
|
|
|
**(Needs liking to a script)**
|
|
|
|
A comparison of climatological variables allows for a match between reports in the [duplicate identification](Workflow/duplicate-indentification) procedure done by [`new_get_pairs.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/new_get_pairs.R).
|
|
|
|
|
|
|
|
**Met Office track check**
|
|
|
|
-----------------------------------
|
|
|
|
|
|
|
|
Several `dck` have `id`'s that indicate a logbook, sheet or other block of data that can be linked together to form ship tracks.
|
|
|
|
|
|
|
|
The linked `id`'s are checked using the Met Office Quality Control track check (MOQC track check from [IMMA](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/wikis/How-to-install#install-dependencies-with-conda-all-platforms)) as well as for time duplicates.
|
|
|
|
|
|
|
|
Reports that fail the track check are flag as the worst duplicate. Where positions (lat, lon) are similar the best duplicate is select by `dck` priority and number of quality variables found by the climatological check. |
|
|
\ No newline at end of file |
|
|
|
Reports that fail the track check are flag as the worst duplicate. Where positions (lat, lon) are similar the best duplicate is select by `dck` priority and number of quality variables found by the climatological check. The track check is also perform in the same [`new_get_pairs.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/new_get_pairs.R) script. |
|
|
\ No newline at end of file |
