ParseGBIF: An R package for parsing species occurrence records into unique collection events

doi:10.21203/rs.3.rs-3579370/v1

Download PDF

Article

ParseGBIF: An R package for parsing species occurrence records into unique collection events

https://doi.org/10.21203/rs.3.rs-3579370/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 05 Mar, 2024

Read the published version in Scientific Reports →

You are reading this latest preprint version

Biodiversity data aggregators, such as Global Biodiversity Information Facility (GBIF) suffer from inflation of the number of occurrence records when data from different databases are merged but not fully reconciled. The ParseGBIF workflow is designed to parse duplicate GBIF species occurrence records into unique collection events (gatherings) and to optimise the quality of the spatial data associated with them. ParseGBIF provides tools to verify and standardize species scientific names according to the World Checklist of Vascular Plants taxonomic backbone, and to parse duplicate records into unique ‘collection events’, in the process compiling the most informative spatial data, where more than one duplicate is available, and providing crude estimates of taxonomic and spatial data quality. When GBIF occurrence records for a medium-sized vascular plant family, the Myrtaceae, were processed by ParseGBIF, the average number of records useful for spatial analysis increased by 180%. ParseGBIF could therefore be valuable in the evaluation of species’ occurrences at the national scale in support for national biodiversity plans, identification of plant areas important for biodiversity, sample bias estimation to inform future sampling efforts, and to forecast species range shifts in response to global climate change.

Biological sciences/Computational biology and bioinformatics/Classification and taxonomy

Biological sciences/Computational biology and bioinformatics/Computational platforms and environments

Biological sciences/Computational biology and bioinformatics/Data acquisition

Biological sciences/Computational biology and bioinformatics/Data integration

Biological sciences/Computational biology and bioinformatics/Data mining

Biological sciences/Computational biology and bioinformatics/Data processing

Biological sciences/Computational biology and bioinformatics/Databases

Biological sciences/Computational biology and bioinformatics/Software

digital duplicates

gatherings

Global Biodiversity Information Facility

Myrtaceae

species taxonomic names

synonyms

taxonomic inflation

World Checklist of Vascular Plants

We are in a biodiversity and climate crisis in which almost 40% of plant species are threatened¹. A confounding factor for our attempts to mitigate the impacts of Climate Change and the Biodiversity Crisis is that we know relatively little about plant occurrences², and much of what we think that we do know is based on species distribution models.

Global plans to mitigate the biodiversity crisis include the High Ambition Coalition 30x30 initiative, a commitment to conserve 30% of the terrestrial environment by 2030, and the Global Biodiversity Framework (GBF) of the Convention on Biological Diversity (CBD). Both require adequate knowledge of species and their occurrences in order to be effective³. Such knowledge is, however, lacking for most of the world’s biodiversity hotspots, with much of the tropics being characterised by low numbers of observations and very biased sampling^4,5. For example, in GBIF the plant diversity of the Amazon forest biodiversity hotspot is documented by an average of 10 to 14 (Source: GBIF, biological collections occurrence data) occurrence records per 100 km². In contrast, the Mesoamerican biodiversity hotspot in Costa Rica is documented by 10,539 records per 100 km² (Source: GBIF, biological collections occurrence data). Such gaps can be the result of a lack of primary data (sample effort), or of primary data not having been digitised, and or, incorporated into GBIF (data capture). Our knowledge of plant diversity is therefore both very uneven and incomplete, making it unsuitable for managing hotspots for plant conservation at this critical time. As a result, much of our knowledge on species richness and distribution is inferred using distribution models and interpolation, both of which are problematic if not validated or when used to identify hotspots of diversity and priority areas for conservation⁶. More recent applications of machine learning to address this problem include those by Richard-Bollans et al (2023) and Cai et al (2022)^7,8.

The Global Biodiversity Information Facility (GBIF) is the largest occurrence data aggregator, with over 2.3 billion records (accessed June 2023). With the aggregation of occurrences records, new challenges emerge, including inconsistencies in backbone taxonomy across databases and large numbers of duplicate records. This phenomenon arises because of several physical duplicates of biological specimens being collected at the same time, which are then distributed to several institutions, and in the process, accumulate conflicting species identities and localities. Sources of conflict can include differences in taxonomic opinion / competence, approaches to transcribing and uploading of the data to information facilities. In addition, as identified by Feng et al.⁹, “some databases develop backbone systems (e.g., BIE backbone, GBIF backbone, MOL backbone), some databases adopt a name scrubbing tool that standardizes names towards pre-selected taxonomic systems (e.g., BIEN, GIFT, TRY), some rely on multiple taxonomic systems (e.g., iNaturalist, EOL), and some do not implement a strong regulation on taxonomic names (e.g., VertNet)”. The above leads to the inflation of the number of occurrence records as data from different databases are merged but not reconciled. In addition, therefore, occurrence data from aggregators suffers from inflation of the number of occurrences, as well as the poor and biased sampling effort identified above.

Similar inconsistencies arise with respect to spatial data (REF) because of transcription errors and modification of the data. For example, some contributors may use centroids to consist the data format, others may use label notes to generate spatial coordinates that were not recorded at the time of observation, and others may apply data to the wrong fields. For example, data entry undertaken at the Geneva herbarium (G) assigned latitude coordinates to longitude coordinates and vice versa; at the Instituto Nacional de Pesquisas da Amazônia (INPA), a single individual, ‘Mike Hopkins’ was listed in the ‘recordedBy’ field for every occurrence record, and at the Field Museum (F), centroid coordinates were applied. Once consolidated with other data sets, such errors and inconsistencies create superfluous occurrence records.

This can result in a single observation / data point being represented by 30 or more records (e.g. Gardner 417) with different species names and locality information. Such inflation leads to errors in species richness measures, both for higher taxon ranks but also for points on the globe, which in turn, can impact on ecological, biogeographic and evolutionary studies^10–12.

In order to mitigate duplication and errors in the global species occurrence dataset represented by GBIF, we aimed to harness two resources in an automated manner, the World Checklist of Vascular Plants (WCVP) taxonomic backbone¹³ and the fields appended to GBIF occurrence records. The WCVP taxonomic backbone is a database linking 1.4 million global plant names to 426,624 accepted species (https://wcvp.science.kew.org/). GBIF issues and flags (https://data-blog.gbif.org/post/issues-and-flags/) comprise > 50 appended fields, 33 of which correspond to geospatial issues.

We designed ParseGBIF to parse duplicate records into unique ‘collection events’ or ‘gatherings’, and in the process compile the most informative associated taxonomic and spatial data (where more than one duplicate is available). This required the generation of a unique identifier string combining the plant family name + first collector’s surname + the collection number required the generation of a collector dictionary, i.e. a list of the main collector names extracted from the dataset. We also used verbatim issues fields to score the completeness of each record with respect to geospatial and taxon identity fields, as well as to assess the consistency of the species epithet applied across duplicates of a unique collection event.

Testing

ParseGBIF has been developed to work primarily with the GBIF database, which uses 100 different sources to assemble the GBIF backbone taxonomy¹⁴. We tested ParseGBIF using the records of the family Myrtaceae available from GBIF. This family was selected because of its relatively large size (ca 6,000 species in 132 genera) and cosmopolitan distribution¹⁵. To evaluate the impact of ParseGBIF on species distribution records we asked the following questions: 1. How many duplicate records have been identified (and eliminated)? (2) How many unique collection events had duplicates with non-identical spatial data that was merged by ParseGBIF? (3) How many unique collection events with useable spatial data were recovered? (4) How was the average number of occurrence records per taxon impacted by the application of ParseGBIF? 5. Were there any differences between richness patterns of Myrtaceae produced by GBIF and ParseGBIF data?

We first describe a typical ParseGBIF workflow and then show the results of the workflow application to the distribution records of the family Myrtaceae.

Typical ParseGBIF workflow

ParseGBIF can be run as a single workflow, or as the individual functions to address specific tasks (Table 1, Fig. 1). ParseGBIF can also be run in association with other packages such as Gridder (Grid Detection and Evaluation in R, https://biogeographylab.github.io/GridDER.github.io/ ) or BDC¹⁶. After converting the GBIF data to a desirable format and selecting the most informative records, the resulting datasets can be downloaded and used in further analyses, e.g. spatial.

Table 1

A typical workflow for a ParseGBIF project.
Project step	Relevant function
GBIF data preparation	download_gbif_data_from_doi prepare_gbif_occurrence_data select_gbif_fields extract_gbif_issue
Check species names against WCVP database	wcvp_get_data wcvp_check_name wcvp_check_name_batch standardize_scientificName
Collectors Dictionary	collectors_prepare_dictionary collectors_get_name generate_collection_event_key
Selecting the master digital voucher	select_digital_voucher
Export dataset for further analysis	export_data parseGBIF_summary

GBIF data download and preparation

To download GBIF occurrence data, the DOI URL address generated by the manual search previously performed on the GBIF portal is entered as a parameter in the download_gbif_data_from_doi function. The function will download and unzip the file in the indicated destination folder. To prepare occurrence data downloaded from GBIF to be used by ParseGBIF functions, it is necessary to run prepare_gbif_occurrence_data. This will select the desired fields (“standard” or “all”) and rename them. The “standard” format has 54 data fields, and the “all” format, 257 data fields. The selection is enabled by the select_gbif_fields function.

As part of the data preparation, it is possible to check whether downloaded records have been identified by GBIF as having “issues”, i.e. either altered by GBIF during processing or flagged as potentially invalid, unlikely, or suspicious. From the list of all issues identified by GBIF (https://gbif.github.io/gbif-api/apidocs/org/gbif/api/vocabulary/OccurrenceIssue.html) we selected only those potentially influencing geospatial interpretation of records (33 categories, Supplementary Table S1). Each issue category was characterised as having a potentially no, low, medium or high impact on coordinate precision, and a selection score (0, -1, -3, -9) were assigned to each record. The lowest selection score (-9) indicates records unsuitable for spatial analysis. The function extract_gbif_issue produces a summary showing the total number of records in each issue category.

Species name check against WCVP database

The World Checklist of Vascular Plants (WCVP) database (Royal Botanic Gardens Kew: https://powo.science.kew.org/about-wcvp) can be downloaded to a folder of the user's choice or into memory using get_wcvp function. The output has 33 columns.

Species’ names can be checked against the WCVP database one by one or in a batch mode. To verify individual names, the function wcvp_check_name is used. To check names in a batch mode, there is wcvp_check_name_batch function. It uses the occurrence data (“occ”) and WCVP names list (“wcvp_names”) generated in the previous steps.

To bring species’ names in line with the WCVP format, the function standardize_scientificName inserts space between the hybrid separator (x) and specific epithet, and also standardizes abbreviations of infrataxa (variety, subspecies, form). The function get_lastNameRecordedBy returns the surname of the main collector in “recordedBy” field.

Creating Collectors Dictionary

A necessary step for parsing duplicate records is to have a robust key for each unique collecting event (aka ‘gathering’). The inclusion of the plant family name in the collection event key, proposed by Nicolson¹⁷ avoids the merging of distinct collection events in the case of low collection numbers common surnames. Including the collection event date in the key would be the most powerful way to avoid the merging of distinct collection events, however, collection date information is often not present in occurrence data records limiting the effectiveness of such an approach. We therefore generated a string that combined the plant family name + the first collector’s surname + the collection number (Moura et al. 2022). For the event key to be effective it is essential to consistently record the collector surname and for this purpose we provide a collector dictionary, i.e. a curated list of the main collector surnames extracted from the GBIF dataset. collectors_prepare_dictionary function extracts the surname of the main collector, based on the “recordedBy” field and generates a list relating the surname of the main collector and the downloaded data. This is followed by the standardisation of the main collector’s last name in the “nameRecordedBy_Standard” field, with respect to lowercase and non-ascii characters. This ensures that a botanical collector is always recognized by the same surname. Where the searched name is present in the collector’s dictionary, then the function retrieves the surname of the main collector as recorded in the “recordedBy” field, at which point the “CollectorDictionary” field will be marked as ‘checked’. If not recognised, then the function returns the surname of the main collector, extracted automatically from the “recordedBy” field and the record will remain unchecked. Unchecked records are then reviewed manually. The Collector Dictionary supplied with ParseGbif contains all of the collector surnames, checked, that were included in the GBIF download.

Digital voucher selection

Where duplicate records of unique collection events are present, the function select_digital_voucher selects the best record as the basis for the single unique collections event record. The best record is defined as that with the highest total score, for the sum of spatial data quality + record completeness.

Spatial data is scored based on the following GBIF issues (see section 2.1 above):

Not applicable, “selection_score” equals “zero”
Does not affect coordinate accuracy, “selection_score” equals − 1
Potentially affect coordinate accuracy, “selection_score” equals − 3
Records to be excluded from spatial analysis, “selection_score” equals − 9

Record completeness scored is measured using the sum of the following flags being equal to TRUE (all “selection_score” equals 1):

Is there information about the collector?
Is there information about the collection number? Is there information about the year of collection?
Is there information about the institution code?
Is there information about the catalogue number?
Is there information about the locality?
Is there information about the municipality of collection?
Is there information about the state/province of collection?
Is there information about the country (using a GBIF issue COUNTRY_INVALID)?
Is there information about the field notes?

The accepted TAXON_NAME selected is that which has most frequently been applied to the duplicate records at, or below, the rank of species. Where two names are applied with equal frequency, the first TAXON_NAME listed in alphabetical order is chosen to enable automation of the process. Where there is no identification at or below the rank of species, then the unique collection event is indicated as unidentified.

Where unique collection event duplicates cannot be parsed because the collection event key is incomplete, each record is treated as a unique collection event lacking duplicates. Where the collection event key is incomplete because the collector surname could not be recovered, then the record is tagged with the label, UNKNOWN-COLLECTOR.

Merged records

Once a master record is selected for each unique collection event key, duplicates can be removed from the dataset. For each complete unique collection event key, data fields that are empty in the digital voucher record will be populated with data from the respective duplicates. During content merging, we indicate fields associated with the description, location, and data of the unique collection event.

Outputs

Records can be exported at three levels of detail:

All data: all records processed and merged, plus all records removed, either because they are duplicates of a unique collection event, or unusable. To separate the records into three datasets by filtering “parseGBIF_dataset_result” field by ”useable”, “unusable” and “duplicates”.

Usable records: unique collection events complete with WCVP taxonomic identification and useable spatial data. Duplicate and unusable records are excluded.

Unusable records: unique collection events which lack key taxonomic and/or spatial data. This represents data that does not support taxonomic or spatial analyses but likely includes records that could be made useable by through further, manuals checks.

Duplicate records of unique collection events: duplicate records of the useable data could be useful for quality control or for verifying outlier records using a manual check.

Summary views of each export are available in the following configuration through the parseGBIF_summary function. The function summarizes the results of the select_digital_voucher (“occ_digital_voucher”) and export_data (“all_data”) functions. parseGBIF_summary function provides a general summary with totals for the entire dataset: total number of records / total number of unique collection events / total number of duplicate records of unique collection events / total number of usable records. The function export_data, with all records merged, provides a summary of the merged fields, summary of the merged fields for useable records only, including frequency of merge actions on fields in the usable dataset, and a summary of the unusable records, including the frequency of merge actions on fields in the unusable dataset.

Example application

All available Myrtaceae records were download from GBIF (https://doi.org/10.15468/dl.ykrqqv, May 2 2023). The parameters of the download were: 1. Basis of record: preserved specimen; 2. Occurrence status: present; 3. Scientific name: Myrtaceae. In total, the GBIF download contained information on 13,147 unique taxa; of which 9,669 taxa had geographic coordinates suitable for spatial analysis (Table 2, Supplementary Figure S1).

Table 2

GBIF and ParseGBIF datasets
Dataset	All data			Data suitable for spatial analysis
	Records	Number of taxa	Records/Taxon	Records	Number of taxa	Records/Taxon
GBIF	1,301,480	13,147	98.9	840,937	9,669	86.9
ParseGBIF	1,301,480	6,513	199.8	930,616	5,964	156.0

Records modified (merged) by ParseGBIF workflow

Using ParseGBIF, 1,301,480 records representing 6,513 unique taxa downloaded from GBIF were parsed into 930,616 unique collection event records representing 5,964 unique taxa (or 61.7% of the originally downloaded records). The parsing of duplicate records resulted in a doubling of the average number of records per taxa, from 98.9 to 199.8, where all records were parsed. Where only records suitable for spatial analysis were included, the parsing of duplicates resulted in a 1.8 fold increase, from 86.9 to 156. Of the unique collection events recovered, 252,723 (27%) had duplicates with non-identical spatial data.

In total, 37,156 records representing 3,874 taxa modified by the ParseGBIF workflow; of those, 92% (3,546 taxa) were suitable for spatial analysis (Fig. 1). The largest number of modifications to the occurrence related to the ‘Habitat’ field, followed by ‘Field Notes’ and ‘Municipality’ fields (Supplementary Table S2). Taxon richness, calculated for the parsed (merged) records was positively and significantly correlated with the overall taxon richness calculated for the ParseGBIF output (Pearson's product-moment correlation 0.6475, t = 40.5, df = 2271, p-value < 0.0001). This suggests that the areas of high taxonomic richness of Myrtaceae overlapped with the areas where the density of modified records was also high.

Myrtaceae taxon richness

According to both GBIF and ParseGBIF data, the taxon diversity of Myrtaceae was, in general below, 100 taxa per 1 x 1 degree grid square (ca 110 x 110 km at the equator, Supplementary Fig.S1, Fig. 2). The highest taxon richness was found in the coastal areas of Brazil, and in Australia (Supplementary Fig. S1 and Fig. 2). The largest difference between the downloaded GBIF and ParseGBIF taxon richness was found in Brazil (up to 50%, Fig. 3). However, the difference was generally rather small (below 20%) when expressed in taxon numbers (Supplementary Fig. S3). Raw GBIF and ParseGBIF taxon counts in 1 x 1 degree squares were positively and significantly correlated (Pearson's product-moment correlation 0.9699, t = 276.85, df = 4830, p-value < 2.2e-16).

Collector dictionary

The Myrtaceae dataset comprised 155,192 unique ‘recordedBy’ names, of which, 8.28% (12,855) were manually reviewed. The remaining names were suitable for automated processing. The unique collection event with the most duplicates MYRTACEAE_GARDNER_417, which had 32 duplicates in 13 herbarium (E, K, NHMUK, UEFS, S, F, US, CAS, NY, A, GH, W and MNHN (Campomanesia hirsuta Gardner)

ParseGBIF offers a significant improvement on using records as downloaded from GBIF, greatly increasing the number of occurrence records per taxon. This was achieved mainly through the consisting of taxon names, the consisting of spatial data, and the merging of duplicate records, both of which mitigate the inflation in records identified above (See Introduction). The impact of ParseGBIF did, not, however, to alter the species richness patterns for the Myrtaceae dataset. For studies solely interested in species patterns at the global or regional scale, GBIF occurrence records as available through the GBIF download function do not need further processing. For finer scale analyses of occurrence data, however, ParseGBIF will likely add significant value. For example, for the evaluation of species’ occurrences at the national scale, in support of national biodiversity plans, or plant areas important for biodiversity, or the characterisation of sample bias to inform future sampling effort, or the use of occurrence data to model species’ niches, and or in support of species Red Listing.

Comparison of ParseGBIF to other packages

According to a recent review¹⁸ there are at least 17 packages offer taxonomic record cleaning functions for plants (https://mgrenie.shinyapps.io/taxharmonizexplorer/). ParseGBIF is unique in the recovery of unique collection events from GBIF occurrence records, through the application of a collector dictionary and the selection of ranked spatial data. Three other packages (kewr, rWCVP, and treemendous) also apply the WCVP taxonomic backbone. We feel that, the harnessing of issues with occurrence records, flagged by GBIF, to score the spatial data and rank duplicate records provides a novel way to resolve conflicts in spatial data between duplicate records.

The ParseGBIF workflow is also similar to that developed by CNCFlora¹⁹ for the curation distribution records. ParseGBIF differs from Moura et al’s¹⁹ workflow with respect to the method for obtaining occurrence records; ParseGBIF uses a URL generated by a download request on the GBIF portal, whereas the former uses a predetermined list of scientific names. This enables ParseGBIF to process records by taxonomic group or spatial area. In addition, ParseGBIF consists the taxon name applied to duplicates records in an automated manner and aligns them with the WCVP, whilst Moura et al’s¹⁹ workflow consists names manually and aligns them with the Flora do Brasil 2020²⁰. Furthermore and as above, ParseGBIF uses GBIF issues to rank and select the optimum duplicate record spatial data from across the globe; in contrast, Moura et al¹⁹, applies a more rigorous validation of geographic coordinates, cross-referencing the municipality and state together against the CNCFlora gazetteer which is restricted to Brazil. Finally, ParseGBIF populates empty unique collection event record data fields with ranked data, where present, from the respective duplicate records, enabling a complete record to be assembled, even where none of the duplicate records are complete. Such a function is not present in Moura et al¹⁹.

Elements of ParseGBIF are similar to a clustering function recently introduced by GBIF, which allows users to identify records that appear to be derived from the same source (https://docs.gbif.org/course-data-use/en/duplicates.html). GBIF, however, does not use this function to parse the duplicate records into unique collection events, but rather to estimate the extent of duplication within a dataset. In contrast, ParseGBIF removes the duplicates.

We feel that the Collector Dictionary, a list of the main collector names extracted from the dataset, is a useful resource that can also be used independently of the ParseGBIF workflow. We see scope for strengthening the ParseGBIF workflow by adding more active ‘cleaning’ of the spatial data, through the integration of other work packages such as Gridder (Grid Detection and Evaluation in R, https://biogeographylab.github.io/GridDER.github.io/), bdc (A toolkit for standardizing, integrating and cleaning biodiversity data, https://brunobrr.github.io/bdc/), and functions from the CoordinateCleaner package, such as Automated Cleaning of Occurrence Records from Biological Collections (https://cran. r-project .org/package = CoordinateCleaner).

The impact of ParseGBIF on species distribution records

When applied to the Myrtaceae dataset, ParseGBIF had a marked impact on the number of occurrence records and taxon names: over half of taxon names were eliminated, bringing estimated species-richness of the Myrtaceae close to that estimated in the WCVP²¹. In response, the average number of occurrence records with usable spatial data, per taxa, nearly doubled making them more suitable for statistical and/or spatial modelling. The removal of duplicate records and those lacking the spatial quality for spatial analysis, reduced the number of records from 6,513 to 5,964. A visual comparison of species richness patterns before (Supplementary Fig.S1) and after (Fig. 2) applying the ParseGBIF workflow clearly illustrates the above: a straight line in the South Atlantic representing records with erroneous coordinates (equal longitude and latitude coordinates, Supplementary Fig.S1) being absent from the processed records (Fig. 2). Not all geospatial issues, however, could be resolved by ParseGBIF, including country and province centroids and records “falling” off the coast, i.e. located beyond the coastline due to georeferencing errors. For this reason we advise the application of ParseGBIF in combination with Gridder or bdc.

Of the unique collection events recognised, nearly 60% suitable for spatial analysis included modified (merged) fields which included a higher information content, particularly with respect to habitat and collection locality descriptions, important information in high resolution ecological and niche studies. The strong correlation between species richness in the modified cells, compared to unmodified cells suggests that ParseGBIF workflow does not impact the mapping of species distributions at the global or regional scale, but that it could provide valuable information at the fine (national subnational) scale and in species-poor, potentially under-sampled locations.

The impact of ParseGBIF on taxon richness patterns of Myrtaceae

The patterns of taxon richness produced by GBIF and ParseGBIF records were similar and consistent with the earlier assessments of Myrtaceae distribution¹⁵. Brazil and Australia appeared to be centres of taxon richness with over 100 taxa per 1 x 1 degree grid square. Two notable exceptions were Borneo and Thailand where taxon richness was lower than expected¹⁵.

When compared, per grid square taxon richness of Myrtaceae estimated using GBIF and ParseGBIF data differed by 20 taxa or less in the majority of grid squares. There was a strong positive significant correlation (r = 0.97) between taxon richness produced by GBIF and ParseGBIF records suggesting that the workflow did not alter taxon richness distribution patterns at the global scale.

Data Availability

The ParseGBIF R package and Manual are available from GitHub: https://github.com/pablopains/parseGBIF.

The Myrtaceae dataset is available from Figshare: Bystriakova, Nadia; de Melo, Pablo Hendrigo Alves; Monro, Alexandre (2023). Myrtaceae Dataset. figshare. Dataset. https://doi.org/10.6084/m9.figshare.24465733.v1

Acknowledgements

This work was made possible by funding from “The 3 T’s Charitable Trust” and forms part of RBG Kew’s ‘Documenting Biodiversity’ initiative. We thank Steve Bachman, Matilda Brown and Justin Moat for comments on the workpackage workflow.

Author Contributions

PHAM, NB and AM conceived the ideas and designed methodology; PHAM collected the data; PHAM and NB analysed the data; NB and AM led the writing of the manuscript; EL reviewed the results of the data analysis and the manuscript. All authors contributed critically to the drafts and gave final approval for publication.

Competing interests
The author(s) declare no competing interests.

Supplementary Information

Supplementary Information 1: Supplementary Table S1

Supplementary Information 2: Supplementary Table S2; Supplementary Figs. S1 – S3

Nic Lughadha, E. et al. Extinction risk and threats to plants and fungi. Plants People Planet 2, 389–408 (2020).
Meyer, C., Weigelt, P. & Kreft, H. Multidimensional biases, gaps and uncertainties in global plant occurrence information. Ecol. Lett. 19, 992–1006 (2016).
Higino, G. T. et al. Mismatch between IUCN range maps and species interactions data illustrated using the Serengeti food web. PeerJ 11, 1–19 (2023).
Oliver, R. Y., Meyer, C., Ranipeta, A., Winner, K. & Jetz, W. Global and national trends, gaps, and opportunities in documenting and monitoring species distributions. PLoS Biol. 19, 1–14 (2021).
García-Roselló, E., González-Dacosta, J. & Lobo, J. M. The biased distribution of existing information on biodiversity hinders its use in conservation, and we need an integrative approach to act urgently. Biol. Conserv. 283, 110118 (2023).
Wyborn, C. & Evans, M. C. Conservation needs to break free from global priority mapping. Nat. Ecol. Evol. 5, 1322–1324 (2021).
Richard-Bollans, A. et al. Machine learning enhances prediction of plants as potential sources of antimalarials. Front. Plant Sci. 14, 1–14 (2023).
Cai, L. et al. Global models and predictions of plant diversity based on advanced machine learning techniques. New Phytol. 237, 1432–1445 (2023).
Feng, X. et al. A review of the heterogeneous landscape of biodiversity databases: Opportunities and challenges for a synthesized biodiversity knowledge base. Glob. Ecol. Biogeogr. 31, 1242–1260 (2022).
Schellenberger Costa, D. et al. The big four of plant taxonomy – a comparison of global checklists of vascular plant names. New Phytol. 240, 1687–1702 (2023).
Mesibov, R. An audit of some processing effects in aggregated occurrence records. Zookeys 2018, 129–146 (2018).
Isaac, N. J. B., Mallet, J. & Mace, G. M. Taxonomic inflation: its influence on macroecology and conservation. Trends Ecol. Evol. 19, 464–469 (2004).
Govaerts, R., Nic Lughadha, E., Black, N., Turner, R. & Paton, A. The World Checklist of Vascular Plants, a continuously updated resource for exploring global plant diversity. Sci. Data 8, 1–10 (2021).
GBIF Secretariat. GBIF Backbone Taxonomy. (2022). Available at: https://doi.org/10.15468/39omei. (Accessed: 16th June 2023)
Govaerts, R., Sobral, M., Ashton, P. & Barrie, F. World Checklist of Myrtaceae. (The University of Chicago Press, 2008).
Ribeiro, B. R. et al. bdc: A toolkit for standardizing, integrating and cleaning biodiversity data. Methods Ecol. Evol. 13, 1421–1428 (2022).
Nicolson, N., Paton, A., Phillips, S. & Tucker, A. Specimens as Research Objects: Reconciliation Across Distributed Repositories to Enable Metadata Propagation. in 2018 IEEE 14th International Conference on e-Science (e-Science) 125–135 (2018). doi:10.1109/eScience.2018.00028
Grenié, M. et al. Harmonizing taxon names in biodiversity data: A review of tools, databases and best practices. Methods Ecol. Evol. 2023, 12–25 (2022).
Moura, C. O. de, Melo, P. H. A. de, Amorim, E. T. de, Marcusso, G. M. & Carvalho-Silva, M. Peperomia (Piperaceae) endemic to Brazil: Distribution, richness, and conservation status. Flora Morphol. Distrib. Funct. Ecol. Plants 297, 152170 (2022).
Jardim Botânico do Rio de Janeiro. Flora e Funga do Brasil. Available at: http://floradobrasil.jbrj.gov.br/. (Accessed: 29th October 2023)
POWO. Plants of the World Online, facilitated by the Royal Botanic Gardens, Kew. (2023). Available at: http://www.plantsoftheworldonline.org/.

No competing interests reported.

Download PDF

Journal Publication

published 05 Mar, 2024

Read the published version in Scientific Reports →

Editorial decision: Revision requested
26 Jan, 2024
Reviews received at journal
26 Jan, 2024
Reviewers agreed at journal
15 Jan, 2024
Reviews received at journal
11 Dec, 2023
Reviewers agreed at journal
28 Nov, 2023
Reviewers agreed at journal
21 Nov, 2023
Reviewers invited by journal
09 Nov, 2023
Editor assigned by journal
09 Nov, 2023
Editor invited by journal
09 Nov, 2023
Submission checks completed at journal
09 Nov, 2023
First submitted to journal
08 Nov, 2023

You are reading this latest preprint version

ParseGBIF: An R package for parsing species occurrence records into unique collection events

Status:

Journal Publication

Version 1

Abstract

Figures

INTRODUCTION

Testing

RESULTS

Typical ParseGBIF workflow

GBIF data download and preparation

Species name check against WCVP database

Creating Collectors Dictionary

Digital voucher selection

Merged records

Outputs

Example application

Records modified (merged) by ParseGBIF workflow

Myrtaceae taxon richness

Collector dictionary

DISCUSSION

Comparison of ParseGBIF to other packages

The impact of ParseGBIF on species distribution records

The impact of ParseGBIF on taxon richness patterns of Myrtaceae

Data Availability

Declarations

References

Additional Declarations

Supplementary Files

Status:

Journal Publication

Version 1