Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Workflow

Workflow · Changes

Page history
added draft of api authored May 19, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 7 deletions
+8 -7
  • Workflow.md Workflow.md +8 -7
  • No files found.
Workflow.md
View page @ 7dadd974
**Data input**
- ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775)
- ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Metadata from WMO Publication 47.
[Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1)
- CLIWOC logbook IDs. (couldn't find the link)
......@@ -8,9 +8,10 @@
[US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out)
- generate_id (by Dave... not so clear the source)
- Precision criteria:
An estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
year and or SID. This precision criteria is required to set tolerances when
allowing a match between reports in the duplicate identification procedure.
an estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
year and or SID. This precision criteria is require in order to set tolerances
when comparing variables from ICOADS. Comparison of variables allows for
a match between reports in the duplicate identification procedure.
- json files.
- seq IDS.
......@@ -42,9 +43,9 @@ A1[rscripts]
id5 --> |process_ids.R|id6[Homogenize and re-format <br> ship IDs from different decks. <br> Links metadata from Pub 47 & logbooks <br> to formed a plausible ship track.]
id6 --> |process_shipdata.R|id7[Process ship data: <br> correction of dates & times.]
id7 --> |new_get_pairs.R|id8[Second duplicate identification. <br> Pairs the reports as duplicate if <br> they have associated ship IDs. <br> Reports that fail the track check <br> are flagged as the worst.]
id8 --> |new_get_dups.R|id9[Count the number of duplicates and flag the best.]
id9 --> |new_merge_ids_year.R|id10[Links of ID's into classes.]
id10 --> |clean_data.R|id11[Cleans of ship data.]
id8 --> |new_get_dups.R|id9[Counts the number of duplicates and flags the best.]
id9 --> |new_merge_ids_year.R|id10[Links ID's into classes.]
id10 --> |clean_data.R|id11[Clean of ship data.]
id11 --> |clean2track.R|id12[Forms ship tracks for linked IDs.]
id12 --> id13[(Output data)]
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control