Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Workflow

Workflow · Changes

Page history
added draft of api authored May 19, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 7 deletions
+8 -7
  • Workflow.md Workflow.md +8 -7
  • No files found.
Workflow.md
View page @ 7dadd974
**Data input** **Data input**
- ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775) - ICOADS v3.0. [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Metadata from WMO Publication 47. - Metadata from WMO Publication 47.
[Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1) [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1)
- CLIWOC logbook IDs. (couldn't find the link) - CLIWOC logbook IDs. (couldn't find the link)
...@@ -8,9 +8,10 @@ ...@@ -8,9 +8,10 @@
[US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out) [US Maury Collection](https://icoads.noaa.gov/software/transpec/maury/mauri_out)
- generate_id (by Dave... not so clear the source) - generate_id (by Dave... not so clear the source)
- Precision criteria: - Precision criteria:
An estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK, an estimate of the precision of each key variable (e.g. sst, lat, lon) per DCK,
year and or SID. This precision criteria is required to set tolerances when year and or SID. This precision criteria is require in order to set tolerances
allowing a match between reports in the duplicate identification procedure. when comparing variables from ICOADS. Comparison of variables allows for
a match between reports in the duplicate identification procedure.
- json files. - json files.
- seq IDS. - seq IDS.
...@@ -42,9 +43,9 @@ A1[rscripts] ...@@ -42,9 +43,9 @@ A1[rscripts]
id5 --> |process_ids.R|id6[Homogenize and re-format <br> ship IDs from different decks. <br> Links metadata from Pub 47 & logbooks <br> to formed a plausible ship track.] id5 --> |process_ids.R|id6[Homogenize and re-format <br> ship IDs from different decks. <br> Links metadata from Pub 47 & logbooks <br> to formed a plausible ship track.]
id6 --> |process_shipdata.R|id7[Process ship data: <br> correction of dates & times.] id6 --> |process_shipdata.R|id7[Process ship data: <br> correction of dates & times.]
id7 --> |new_get_pairs.R|id8[Second duplicate identification. <br> Pairs the reports as duplicate if <br> they have associated ship IDs. <br> Reports that fail the track check <br> are flagged as the worst.] id7 --> |new_get_pairs.R|id8[Second duplicate identification. <br> Pairs the reports as duplicate if <br> they have associated ship IDs. <br> Reports that fail the track check <br> are flagged as the worst.]
id8 --> |new_get_dups.R|id9[Count the number of duplicates and flag the best.] id8 --> |new_get_dups.R|id9[Counts the number of duplicates and flags the best.]
id9 --> |new_merge_ids_year.R|id10[Links of ID's into classes.] id9 --> |new_merge_ids_year.R|id10[Links ID's into classes.]
id10 --> |clean_data.R|id11[Cleans of ship data.] id10 --> |clean_data.R|id11[Clean of ship data.]
id11 --> |clean2track.R|id12[Forms ship tracks for linked IDs.] id11 --> |clean2track.R|id12[Forms ship tracks for linked IDs.]
id12 --> id13[(Output data)] id12 --> id13[(Output data)]
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control