Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
    • Workflow
  • Processing of IDs

Processing of IDs · Changes

Page history
added liz changes authored Jun 11, 2020 by bearecinos's avatar bearecinos
Show whitespace changes
Inline Side-by-side
Showing with 11 additions and 13 deletions
+11 -13
  • Workflow/Processing-of-IDs.md Workflow/Processing-of-IDs.md +11 -13
  • No files found.
Workflow/Processing-of-IDs.md
View page @ 3bbd1e55
......@@ -8,8 +8,7 @@ The following corrections to ship names happen in [`add_shipnames.R`](https://gi
- For `dck` 701 (1867-1899) and `dck` 711 (1889-1899) some ship names are corrected.
- For the period 1663 to 1860, [CLIWOC logbook](https://www.historicalclimatology.com/cliwoc.html) `id`'s from `dck` 730 are converted to ship names using information from the project: <br> https://projects.knmi.nl/cliwoc/download/shiplogbookid21.htm This link does not work.
But this link works: https://stvno.github.io/page/cliwoc/ maybe the projected moved??
- For the period 1663 to 1860, CLIWOC logbook `id`'s from `dck` 730 are converted to ship names using table information from a MS ACCESS database that is no longer available online. Some information is available from: <br> https://www.historicalclimatology.com/cliwoc.html
- For the period 1663 to 1863 ship names from the **US Maury collection** `dck` 701 are extended using information from [this link](http://icoads.noaa.gov/software/transpec/maury/mauri_out). Also data with a missing `id` from `dck` 701 is split into voyages by manual inspection.
......@@ -39,6 +38,5 @@ The following corrections are made in [`new_homog_ids.R`](https://git.noc.ac.uk/
- `id`'s in `dck`'s 194, 201, 202, 203 and 227 are all derived from the same 5-digit ship identifiers. Leading digits are removed where needed.
- Some ship `id`'s are callsigns and need to be reformat to enable linking of data from the same ship across `dck`'s and to be linked to metadata information in WMO Publication No. 47. For more information see [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1) and [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Some ship `id`'s are callsigns and can be used to link to metadata information in WMO Publication No. 47. However some callsigns have been modified in some `dck`, or corrupted, so processing attempts to recover the original callsign in these cases. For more information see [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1) and [Freeman. *et al.,* (2017)](https://doi.org/10.1002/joc.4775).
- Where an `id` is identified as a callsign or an identifier listed in WMO Publication No. 47, other `id`'s containing the same character string are flagged and leading digits are removed. This is with the purpose of homogenising the callsigns across `dck`'s.
\ No newline at end of file
Clone repository

Wiki pages

Home

Introduction
Installation
JASMIN tips

Workflow
- Data selection
- Processing of ID's
- Matching criteria
- Quality control
- Duplicate identification

API Reference

Releases

Examples