Workflow/Processing-of-IDs.md

-Coming soon
\ No newline at end of file
+The pre-processing tasks described here are done in [`process_ids.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rscripts/process_ids.R)
+
+**Corrections**
+---------------------
+The following corrections to ship names are done in [`add_shipnames.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rutils/add_shipnames.R).
+
+- For the period 1878 to 1894 some minor changes to ship names from `dck` 704 are made to correct for typos and other similar problems. 
+
+- For `dck` 701 (1867-1899), and 711 (1889-1899) some ship names are correct.
+
+- For the period 1663 to 1860 CLIWOC logbook (**needs link**) `id`'s from `dck` 730 are convert to ship names using information from the project (https://projects.knmi.nl/cliwoc/download/shiplogbookid21.htm) This link does not work. 
+
+- For the period 1663 to 1863 ship names from the US Maury collection `dck` 701 are extended using information from [this link](http://icoads.noaa.gov/software/transpec/maury/mauri_out). Also data with a missing `id` from `dck` 701 is split into voyages by manual inspection. 
+
+- Ship names from the German Maury collection (`dck` 721) are extent where they overlap with names from US Maury (`dck` 701). Where names are the same across `dck` 701 and 721 and it is not clear if the ships are the same, the `dck` number is then also append (AUSTRALIA, JAMESTOWN, SWORDFISH, ANN MARIA, ASHBURTON). 
+
+- In `dck` 555 (1966-1973) North Pole and South Pole station `id`'s are correct by prepending a "N" or "S" depending on latitude. 
+
+
+**Reformatting**
+---------------------
+- Manual corrections to two `id`'s from `dck` 187 (1946-1956) are made to conform the expected format. 
+
+- For the period 1953 to 1961 `id`'s from `dck` 184 are truncated to remove the first digit which indicates the ocean region, and the `id`'s are reformat to match the expected form.
+
+- Between 1962 and 1963 the `id` **"Eltanin"** is added to `dck` 897, which contains only data from that ship and has a missing `id`.
+
+- Between 1957 and 1961 a small number of `id`'s from `dck` 902 are reformat to match expected format. This is done by prepending a No. "3" to the truncated `id`'s. 
+
+- Between 1930 and 1961 `id`'s for `dck` 118 and 119 (a small number of `id`'s) are reformat to match the expected format. This is done by inserting a 2-digit year. 
+
+- For `dck` 720 and `sid` 135, 8-character `id`s represent a single report. These are truncated to the first 4 digits, and a **"-SEQ"** is append. 
+
+
+**Homogenisation**
+---------------------
+The following corrections are done in [`new_homog_ids.R`](https://git.noc.ac.uk/brecinosrivas/icoads-r-hostace/-/blob/master/rutils/new_homog_ids.R)
+
+- `id`'s in `dck`'s 194, 201, 202, 203 and 227 are all derived from the same 5-digit ship identifiers. Leading digits are remove where needed. 
+
+- Some ship `id`'s that are callsigns and need to be reformat to enable linking of data from the same ship across `dck`'s and in order to be linked to metadata information in WMO Publication No. 47 (Pub. 47, Kent et al. 2007, Freeman et al. 2011). 
+
+- Where an `id` is identify as a callsign or to a different identifier listed in Pub. 47 other `id`'s containing the same character string are flag and leading digits are remove. This with the purpose of homogenising the callsigns across `dck`'s.
+ 
+
+**Linking**
+-------------
+
+To be discussed with Lizz. 
\ No newline at end of file