Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Workflow

Workflow · Changes

Page history
added rest of docs authored May 26, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 10 additions and 8 deletions
+10 -8
  • Workflow.md Workflow.md +10 -8
  • No files found.
Workflow.md
View page @ 97fa7715
**Data input** **Data input**
-------------- --------------
- ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775). The following data is require by the scripts of this repository:
- [ICOADS v3.0](https://icoads.noaa.gov/r3.html). [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Metadata from WMO Publication 47. - Metadata from WMO Publication 47.
[Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1) [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1)
- CLIWOC logbook IDs. (couldn't find the link) - CLIWOC logbook IDs. (**needs a link**)
- Inventory of ship names in the - Inventory of ship names in the
[US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out) [US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out)
- generate_id (by Dave... not so clear the source) - generate_id (**needs description**)
- Precision criteria: - **Precision criteria file**. An estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
an estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
year and or SID. This precision criteria is require in order to set tolerances year and or SID. This precision criteria is require in order to set tolerances
when comparing variables from ICOADS. Comparison of variables allows for when comparing variables from ICOADS. Comparison of variables allows for
a match between reports in the duplicate identification procedure. a match between reports in the duplicate identification procedure.
- Json files containing ITU callsign prefixes associated with a country. - **Json files** containing ITU callsign prefixes associated with a country.
- seq IDS. - **seq IDS.** (**needs description**)
**Processing stages** **Processing stages**
-------------------- --------------------
...@@ -22,7 +23,8 @@ when comparing variables from ICOADS. Comparison of variables allows for ...@@ -22,7 +23,8 @@ when comparing variables from ICOADS. Comparison of variables allows for
The following diagram is a summary of the data processing workflow follow by The following diagram is a summary of the data processing workflow follow by
the shell scripts defined in ```scr```. Each block the shell scripts defined in ```scr```. Each block
represents a main task done by one script in```rscripts```. represents a main task done by one script in```rscripts```.
The corresponding `.R` file name is highlight in grey between each stage. The corresponding `.R` file name is highlight in grey between each stage
(For more information on eah `.R` script, please see the [API-reference](api-reference))
Orange blocks represent pre-processing tasks done to the ICOADS data base, Orange blocks represent pre-processing tasks done to the ICOADS data base,
in order to: in order to:
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control