Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • Introduction

Introduction · Changes

Page history
Update Introduction authored May 19, 2020 by Elizabeth Kent's avatar Elizabeth Kent
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 5 deletions
+4 -5
  • Introduction.md Introduction.md +4 -5
  • No files found.
Introduction.md
View page @ 5ba15c5d
...@@ -23,7 +23,7 @@ of several nations. Truncated formats often did not contain sufficient informati ...@@ -23,7 +23,7 @@ of several nations. Truncated formats often did not contain sufficient informati
to identify the observations made by a particular ship or platform, to identify the observations made by a particular ship or platform,
and these compact formats sometimes converted or encoded data in different ways. and these compact formats sometimes converted or encoded data in different ways.
For example, many observations do not have an identifier linking to the ship For example, many observations do not have an identifier linking to the ship
(**ID**) or platform (**pt**), and for those that do have such identifiers (**ID**) or platform (**PT**), and for those that do have such identifiers
they may be different between data sources. The main types of duplicates are: they may be different between data sources. The main types of duplicates are:
* Observations historically shared among national archives, * Observations historically shared among national archives,
...@@ -37,10 +37,9 @@ likely to have different formats, precision, conversions and metadata. ...@@ -37,10 +37,9 @@ likely to have different formats, precision, conversions and metadata.
* Planned redundancy, for example the ingestion of several near real time data streams. * Planned redundancy, for example the ingestion of several near real time data streams.
There is already a protocol and other tools written in Python to read and The processing software used by ICOADS (https://icoads.noaa.gov/software/) is written in FORTRAN and includes code to translate software to the IMMA1 format [Smith. *et al.,* (2016)], to apply QC and flags, and to identify (and in earlier releases remove) reports likely to be duplicates [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
perform some quality control on the data and to identify duplicate observations
as described in [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775). The code in this repository offer additional quality control
However, the processing methods in this repository offer additional quality control
on the data, duplicate identification and linking of IDs between each pair of duplicate reports. on the data, duplicate identification and linking of IDs between each pair of duplicate reports.
It also provides an identification of the best duplicate by assessing the track It also provides an identification of the best duplicate by assessing the track
(path in lat/lon) of the observation. (path in lat/lon) of the observation.
......
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control