Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Workflow

Workflow · Changes

Page history
corrected typos authored May 26, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 5 deletions
+4 -5
  • Workflow.md Workflow.md +4 -5
  • No files found.
Workflow.md
View page @ e2d2f916
...@@ -20,13 +20,12 @@ when comparing variables from ICOADS (See the [list of ICOADS variables](https:/ ...@@ -20,13 +20,12 @@ when comparing variables from ICOADS (See the [list of ICOADS variables](https:/
**Processing stages** **Processing stages**
-------------------- --------------------
The following diagram is a summary of the data processing workflow follow by The diagram below is a summary of the data processing workflow followed by
the shell scripts defined in ```scr```. Each block the shell scripts defined in ```scr```. Each block
represents a main task done by one script in```rscripts```. represents a main task done by one script in```rscripts```.
The corresponding `.R` file name is highlight in grey between each stage The corresponding `.R` file name has been added in grey between each block. For more information on eah `.R` script, please see look at [API reference page.](api-reference)
(For more information on eah `.R` script, please see the [API-reference](api-reference))
Orange blocks represent pre-processing tasks done to the ICOADS data, - Orange blocks represent pre-processing tasks done to the ICOADS data,
in order to: in order to:
1. Select data taken only by commercial ships, excluding 1. Select data taken only by commercial ships, excluding
...@@ -37,7 +36,7 @@ identification and linking of `id`'s between each pair of duplicate reports. ...@@ -37,7 +36,7 @@ identification and linking of `id`'s between each pair of duplicate reports.
3. Preformed [quality control](Workflow/quality-control) on the data to point 3. Preformed [quality control](Workflow/quality-control) on the data to point
out the best duplicate. out the best duplicate.
The rest of the blocks represent processing scripts that concentrate in the duplicates - The rest of the blocks represent processing scripts that concentrate in the duplicates
identification and [matching of reports ID's](Workflow/matching-criteria). identification and [matching of reports ID's](Workflow/matching-criteria).
```mermaid ```mermaid
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control