Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
I ICOADS R HOSTACE
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • brivas
  • ICOADS R HOSTACE
  • Wiki
  • API Reference

API Reference · Changes

Page history
finished variables and main links authored May 21, 2020 by bearecinos's avatar bearecinos
Hide whitespace changes
Inline Side-by-side
Showing with 65 additions and 63 deletions
+65 -63
  • API-Reference.md API-Reference.md +65 -63
  • No files found.
API-Reference.md
View page @ 658241cf
...@@ -8,24 +8,24 @@ ____________ ...@@ -8,24 +8,24 @@ ____________
Script | Description Script | Description
-------- |:------------ -------- |:------------
`split_by_type.R` | Separates records according to the different platform types. This is done following a [selection criteria](Workflow/data-selection). [`split_by_type.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/split_by_type.R) | Separates records according to the different platform types. This is done following a [selection criteria](Workflow/data-selection).
`simple_dup.R` | Duplicate record identification among ship data and the rest of the different platform types for which the records show a matching `date` , `time` and position `(lat, lon)`. [`simple_dup.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/simple_dup.R) | Duplicate record identification among ship data and the rest of the different platform types for which the records show a matching `date` , `time` and position `(lat, lon)`.
`ship2plat.R` | Excludes non-ship data. Uses additional information from WMO Publication 47 to flag non-ship data. [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1) [`ship2plat.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/ship2plat.R) | Excludes non-ship data. Uses additional information from WMO Publication 47 to flag non-ship data. [Kent. *et al.,* (2007)](https://doi.org/10.1175/JTECH1949.1)
`process_ids.R` | Re-format of ship IDs that comes from different data sources (`SID`) to enable linking of data from the same ship (same ship name) across different `DCK`s. And to also enable linking to metadata information in WMO Publication No. 47. [`process_ids.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/process_ids.R) | Re-format of ship IDs that comes from different data sources (`SID`) to enable linking of data from the same ship (same ship name) across different `DCK`s. And to also enable linking to metadata information in WMO Publication No. 47.
`process_shipdata.R` | Corrects dates and times errors noticed in some `DCK`. Largely arise from confusion over historical definitions of the marine day and conversions between local time and UTC. [`process_shipdata.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/process_shipdata.R) | Corrects dates and times errors noticed in some `DCK`. Largely arise from confusion over historical definitions of the marine day and conversions between local time and UTC.
`new_get_pairs.R` | Duplicate record identification within the ship data. Pairs the reports as duplicate if they have associated ship `ID`s. The candidate pairs are then selected according to i) the number of matching elements (similar content of variables within a specific tolerance), ii) the `DCK`s, and iii) a comparison of the `ID`s. [`new_get_pairs.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/new_get_pairs.R) | Duplicate record identification within the ship data. Pairs the reports as duplicate if they have associated ship `ID`s. The candidate pairs are then selected according to i) the number of matching elements (similar content of variables within a specific tolerance), ii) the `DCK`s, and iii) a comparison of the `ID`s.
`new_get_dups.R` | Counts the number of duplicated records and flags the best according to a [quality control criteria](Workflow/quality-control). Groups duplicated records by common `callsings`. [`new_get_dups.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/new_get_dups.R) | Counts the number of duplicated records and flags the best according to a [quality control criteria](Workflow/quality-control). Groups duplicated records by common `callsings`.
`new_merge_ids_year.R` | Links `ID`'s into classes. Ship tracks of the linked `ID`'s are then checked. Reports that fail the track check are flagged as the worst duplicate. Uses a shipping tracking alogrithm from [**imma**.](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/wikis/How-to-install#install-dependencies-with-conda-all-platforms) [`new_merge_ids_year.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/new_merge_ids_year.R) | Links `ID`'s into classes. Ship tracks of the linked `ID`'s are then checked. Reports that fail the track check are flagged as the worst duplicate. Uses a shipping tracking alogrithm from [**imma**.](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/wikis/How-to-install#install-dependencies-with-conda-all-platforms)
`clean_data.R` | ---. [`clean_data.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/clean_data.R) | ---.
`clean2track.R` | Forms ship tracks for linked `ID`s. --. [`clean2track.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/clean2track.R) | Forms ship tracks for linked `ID`s. --.
**Utils** **Utils**
____________ ____________
Function | Description Function | Description
-------- |:------------ -------- |:------------
`add_date2.R ` | [`add_date2.R `](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rutils/add_date2.R) | Adds a date variable to a file (YY_MM.Rda) based on yr, mo, dy, hr. Invalid values are set to missing. It generates a date variable with missing hour set to local noon and adds a **date.flag.** <br><br> `0 = valid date & time`<br> `1 = invalid date or time (time not missing)` <br> `2 = valid date, hr missing, 12 local added`
`add_dck_priority.R ` | [`add_dck_priority.R `](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rutils/add_dck_priority.R) | Function use to identify duplicates. During the identification procedure priorities are assigned to data from each`dck` (See [source](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rutils/add_dck_priority.R)), data expected to be of best quality is assigned a priority of 1, data with larger priority numbers will be flagged as the worst duplicate if identified as potential matches. Priority values are based on those from [ICOADS.](https://icoads.noaa.gov/)
`add_ID_class.R ` | `add_ID_class.R ` |
`add_shipnames.R` | `add_shipnames.R` |
`assess_match.R` | `assess_match.R` |
...@@ -50,6 +50,8 @@ Function | Description ...@@ -50,6 +50,8 @@ Function | Description
`write_dup_func.R` | `write_dup_func.R` |
**ICOADS variables used** **ICOADS variables used**
Visit the [ICOADS main website](https://icoads.noaa.gov/) or check th [IMMA report](https://icoads.noaa.gov/e-doc/imma/R3.0-imma1.pdf)
________________ ________________
Code | Description Code | Description
-----: |:------------ -----: |:------------
...@@ -85,54 +87,54 @@ Code | Description ...@@ -85,54 +87,54 @@ Code | Description
`mds` | metadata source `mds` | metadata source
`mo` | month UTC `mo` | month UTC
`n` | cloud amount `n` | cloud amount
`ne` | `ne` | total cloud amount
`nh` | `nh` | amt. of lowest clouds
`nhe` | `nhe` | lower cloud amount
`nid` | `nid` | national source indic.1
`oav` | `oav` | alkalinity value
`oaz` | `oaz` | alkalinity depth
`ocv` | `ocv` | total chlorophyll value
`ocz` | `ocz` | total chlorophyll depth
`onv` | `onv` | nitrate value
`onz` | `onz` | nitrate depth
`oov` | `oov` | dissolved oxygen
`ooz` | `ooz` | dissolved oxygen depth
`ophv` | `ophv` | pH value
`ophz` | `ophz` | pH depth
`opv` | `opv` | phosphate value
`opz` | `opz` | phosphate depth
`osiv` | `osiv` | silicate value
`osiz` | `osiz` | silicate depth
`osv` | `osv` | salinity value
`osz` | `osz` | salinity depth
`pt` | `pt` | platform type
`qci` | `qci` | quality control indic.
`rh` | `rh` | relative humidity
`ri` | `ri` | relative lunar illuminance
`rrr` | `rrr` | amount of precip
`rs` | `rs` | rate of Is (ice accretion on ship)
`sa` | `sa` | solar altitude
`sbi` | `sbi` | sky-brightness indicator
`si` | `si` | SST meas. method ? or indic. for SST meas.
`sid` | `sid` | source ID
`sim` | `sim` | SST measurement method
`slp` | `slp` | air pressure
`sme` | `sme` | source meta. element
`smf` | `smf` | source metadata file
`smv` | `smv` | source format version
`sst` | `sst` | sea surface temperature
`sx` | `sx` | swell period indicator
`uh` | `uh` | NOL high amount
`uid` | `uid` | unique report ID
`um` | `um` | NOL middle amount
`vs` | `vs` | ship's average speed
`vv` | `vv` | visibility
`w` | `w` | wind speed
`w1` | `w1` | past weather
`wbt` | `wbt` | wet-bulb temperature
`wh` | `wh` | wave height
`wmi` | `wmi` | indic. for wave measurement
`ww` | `ww` | present weather
`wwe` | `wwe` | present weather
`wx` | `wx` | wave period indicator
`yr` | `yr` | year UTC
\ No newline at end of file \ No newline at end of file
Clone repository
  • API Reference
  • Examples
  • Home
  • How to install
  • Introduction
  • JASMIN tips
  • Releases
  • Workflow
  • Workflow
    • Data selection
    • Duplicate indentification
    • Matching criteria
    • Processing of IDs
    • Quality control