Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Workflow

Workflow · Changes

Page history
added rest of docs authored May 26, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 10 additions and 8 deletions
+10 -8
  • Workflow.md Workflow.md +10 -8
  • No files found.
Workflow.md
View page @ 97fa7715
**Data input**
--------------
- ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
The following data is require by the scripts of this repository:
- [ICOADS v3.0](https://icoads.noaa.gov/r3.html). [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Metadata from WMO Publication 47.
[Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1)
- CLIWOC logbook IDs. (couldn't find the link)
- CLIWOC logbook IDs. (**needs a link**)
- Inventory of ship names in the
[US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out)
- generate_id (by Dave... not so clear the source)
- Precision criteria:
an estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
- generate_id (**needs description**)
- **Precision criteria file**. An estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
year and or SID. This precision criteria is require in order to set tolerances
when comparing variables from ICOADS. Comparison of variables allows for
a match between reports in the duplicate identification procedure.
- Json files containing ITU callsign prefixes associated with a country.
- seq IDS.
- **Json files** containing ITU callsign prefixes associated with a country.
- **seq IDS.** (**needs description**)
**Processing stages**
--------------------
......@@ -22,7 +23,8 @@ when comparing variables from ICOADS. Comparison of variables allows for
The following diagram is a summary of the data processing workflow follow by
the shell scripts defined in ```scr```. Each block
represents a main task done by one script in```rscripts```.
The corresponding `.R` file name is highlight in grey between each stage.
The corresponding `.R` file name is highlight in grey between each stage
(For more information on eah `.R` script, please see the [API-reference](api-reference))
Orange blocks represent pre-processing tasks done to the ICOADS data base,
in order to:
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control