Manage Resources Menu

This menu is visible to users with an Admin or Manager role.

This page allows users having the appropriate role (managers and administrators) to make changes to existing resources or to create new resources.

IPTManageResources

Manage Resources Table

When the Manage Resources page is first opened, it shows a table of existing resources that the current user has permission to change, including those created by this user and those that this user has been invited to manage by others. Refer to the information under the Public Resources Table section for detailed explanations of the Name, Organization, Type, Subtype, Records, Last Modified, Last publication, and Next publication columns. In addition, the Manage Resources Table includes the following column of basic information about the resources:

  • Visibility - a category stating who has access to view the resource. If the resource is "Public", all users will be able to see it on the Public Resources Table on the Home page. If the resource is "Private", it will be visible in the Manage Resources table only to the user who created it, to those who have been invited to manage it, and to users having the Admin role. Details about inviting others to manage a resource are given in the "Resource Managers" section under the "Resource Overview" heading in the "Manage Resources" section.

  • Author - the IPT user who created the resource.

Create a New Resource

Below the Manage Resource table is a form that can be used to create a new resource. First, a unique "shortname" must be provided for the resource. This short name will be used to uniquely identify the resource within the IPT instance, and will be used within the URL to access the resource via the Internet. The shortname must be at least three characters in length, may contain alphanumeric characters (A-Z, a-z and 0-9), but must not contain white space, punctuation other than hyphens or underscores, or accented characters (e.g., "firstresource" or "first_resource", but not "first resource" or "première ressource!"). Second, a resource type must be provided. Please note that when an optional Darwin Core archived resource is loaded (see below) the type will be determined automatically and overwrite this selection. Third, an optional archived resource can be uploaded. The following sections describe different types of archived resources from which a new resource can be derived:

Of course, you can always just create an entirely new resource without loading an existing archived resource. With this option the resource configuration will have to be created in its entirety through the IPT forms, including uploading source data files (or connecting to a database or URLs) and mapping the fields therein to terms in the appropriate extension or extensions. Please note the IPT has a 10GB file upload limit, however, there is no limit to the size of Darwin Core Archive the IPT can export/publish. Refer to the note about file upload limits to find out how to work around the file upload limit.

Begin by entering a new resource shortname as described above, and then click on the button labelled "Create". This will open the Resource Overview page. Proceed by completing the various sections of the manage resource page based on the descriptions under the "Resource Overview" heading of the "Manage Resources Menu" section.

Upload a Darwin Core Archive

The IPT is able to import valid Darwin Core Archive files up to 10GB in size. Information about Darwin Core Archives can be found on the Darwin Core web site, with further information about the IPT’s use of them here. To import a Darwin Core Archive, click on the button labelled "Choose File", then navigate to and select the intended archive file. After selecting the file, its name will appear next to the "Choose File" button.

IPTManageResourceUploadDwcA

Click on the button labelled "Create". If there is a problem importing the selected file, an error message will alert the user. If the import is successful, a Resource Overview page will appear with an informational message at the top describing the results of the import process.

IPTManageResourceUploadDwCASuccess

Upload a zipped IPT resource configuration folder

It is possible to create a copy of a resource from its zipped IPT resource configuration folder. The only condition is that the resource must have been created under a compatible version of the IPT. Effectively, this will copy all the resource’s metadata, source data, and mappings. It will not copy the resource’s registration information, version history, DOI(s), version number, managers, publication status, created date, last publication date, or even preserve the resource short name.

To do so, follow these instructions:

  1. Locate the resource configuration folder corresponding to the resource you want to copy. The resource configuration folders are stored inside the $data-directory/resources folder, and named using the resource short name. For example, if the resource had short name "ants", it would be found at $data-directory/resources/ants.

  2. Zip (compress) the resource configuration folder: ants/ants.zip

  3. On the "Create a New Resource" section on the "Manage Resource Menu" page:

    1. Enter a new resource short name. You can preserve the zipped resource’s short name, provided it doesn’t already exist in your IPT.

    2. Click on the button labelled "Choose File", then navigate to and select the intended zipped resource configuration folder.

    3. After selecting the file, its name will appear next to the "Choose File" button. Click on the button labelled "Create". If there is a problem importing the selected file, an error message will alert the user. If the import is successful, a Resource Overview page will appear with the resource metadata, source data, and mappings all copied from the zipped resource into the new resource.

Upload a metadata file

The IPT is able to import and export valid dataset metadata files that conform to the GBIF Metadata Profile. Information about the GBIF EML Metadata Profile and how to author a metadata document conforming to the GBIF Metadata Profile Darwin Core can be found in the GBIF Metadata Profile – How To Guide. To import a metadata file, select the resource type "metadata-only", then click on the button labelled "Choose File", navigate to and select the intended metadata file. After selecting the file, its name will appear next to the "Choose File" button.

IPTManageResourceUploadEml

Click on the button labelled "Create". If there is a problem importing the selected file, an error message will alert the user. If the import is successful, a Resource Overview page will appear with the metadata having been populated. The source data and mapping sections will remain hidden since this is a metadata-only resource. Should you decide to add primary dataset at a later time, just change the resource type in the Basic Metadata page of the metadata.

Edit an existing resource

The table of existing resources shows only those resources that can be edited by the current user. To edit a resource, click on the name of the resource in the table of resources. The link will open the Resource Overview page for the selected resource. Refer to the descriptions under the "Resource Overview" heading of the "Manage Resources Menu" section for details on how to edit various aspects of the resource.

Resource Overview

This page allows users having managerial permission to make changes to various aspects of a resource’s configuration. The name of the resource is given at the top of the page under the menu bar. If the resource has not been given a title, the resource shortname will appear at the top of the page and will act as a title instead. Below the resource name is a table showing categories of the resource configuration on the left with corresponding sections to the right. Information icons throughout the table can help guide managers in using each category. Each of these categories is configured separately as explained in detail in the following sections.

IPTManageResourceOverview
IPTManageResourceOverview 2

Source Data

This area of the Resource Overview page allows a user to import primary data from files, databases or URLs into the IPT. If a resource has no source data it is considered a metadata-only resource, with information about a data set or collection, but without any primary data. It is possible to connect a resource to more than one data source if the sources are related to each other. More about relating multiple data sources is explained in the Implementation Guide section of the Darwin Core Text Guide. Following are explanations for the preliminary step of choosing the source data, either from text files, database sources or a text file available at a URL:

File as data source

The IPT can import uncompressed delimited text files (CSV, tab, and files using any other delimiter) or equivalent files compressed with Zip or Gzip. Excel files are also supported. Click the ┇ menu at "Source Data" and select "Add". Then select "File" from the dropdown box in the modal window and click on the button labelled "Browse…" or "Choose file" to navigate to and select the file to import. The file name can only be composed of alphanumeric characters (A-Z, 0-9), spaces, underscores, full stops, parentheses, and hyphens. After selecting the file, its name will appear to the right of the "Browse…" button.

IPTManageResourceSourceSummary

Click on the button labelled "Clear" to remove the choice of selected file and return to the previous state before any data source was selected. Or, click on the button labelled "Add" to open the Source Data File detail page (if there is the risk of overwriting a file with the same name, a dialog opens that asks the user to confirm they actually want to overwrite it).

If the IPT detects the number of columns in a mapped data source has changed when overwriting it, the user is warned that they should update its mappings.
Upload limits

The IPT has an upload size limit of 10GB. There is no limit to the size of Darwin Core Archive the IPT can export/publish though. For loading datasets larger than 10GB in size into the IPT, the following work-arounds are recommended:

  • compress the file with Zip or Gzip

  • load the data into one of the many databases supported by the IPT

  • retrieve the file from a URL

  • split the file up (when the dataset is published the IPT will concatenate the files in the order they are mapped)

This page shows the name of the resource along with a summary of the file characteristics (readability, number of columns detected, absolute path to the file, the file size, the number of rows detected, and the date the file was last loaded into the IPT). The Source Data File detail page allows the user to view and edit the parameters that describe the content of the selected file, and to use these settings to analyse and preview the file.

IPTManageResourceSourceDataFormat
  • Source Name - header, the name of the file selected, without the file extension.

  • Source type - type of the source, Text file here.

  • Readable - this icon indicates whether data are accessible using the file format information provided on this page.

  • File - the full path to the location of the file to use as the data source.

  • Columns - the number of columns in the dataset as configured using the parameters on this page.

  • Rows - the number of rows found in the data file. (Note: This number helps check if all records are identified.)

  • Size - the file size.

  • Modified - the date stamp of the file indicating when it was last saved.

  • Source log - this link downloads the file containing the log produced when processing the file using the information contained on this page. Any problems encountered while processing the file, such as missing data and unexpected formatting will be in this log file.

  • Analyse - (from Options dropdown) click on this button to generate a data summary based on the file settings on this page. The analysis will indicate whether the file is readable, and if so, how many columns it contains.

  • Preview - (from Options dropdown) click on this button to see an interpretation of the data within the file.

  • Number of Header Rows - 0 if the file does not contain a row of column names, 1 if the file does contain a header row.

  • Field Delimiter - the character or characters that signify a break between columns of data.

  • Field Quotes - a single character (or none) that is used to enclose the contents of a column in the data (e.g., ' or "). Please note this will not properly enclose columns whose content includes newline characters (\n) or carriage returns (\r).

  • Multi-value Delimiter - a single character that delimits the values in a multi-value field (e.g., | or ;).

  • Character Encoding - the system that defines byte-wise definitions of the characters in the data (e.g., ISO 8859-5 refers to the Cyrillic alphabet).

  • Date Format - a code describing the format of fields having a date data type (e.g., YYYY-MM-DD for four-digit year, two-digit month, and two-digit day separated by dashes).

  • Selected Worksheet - (Excel files only) this drop down lists the names of all worksheets in the Excel file/workbook. Only 1 worksheet can be used as the data source, defaulting to the first worksheet. After changing the sheet click Analyse to update the row/column information.

After the parameters for the data source have been set so that the file is interpreted correctly, click on the button labelled "Save" to store this configuration. If the save is successful, the Resource Overview page will appear, with summary information about the file. To reopen the Source Data File detail page just click on the appropriate item.

IPTManageResourceSourceSummary

Should the user want to delete this source, they can reopen the Source Data File detail page and press the "Delete source file" button. Be aware though, that any mappings associated to this file will also be deleted.

If the source data are contained in multiple text files, the process described in this section can be repeated for each of the files to import. A zipped folder with multiple text files can also be imported to add multiple source files in one go.

Database as data source

The IPT can use database connections to import data from tables or views. A list of supported database connections is given in the Supported Databases section. To configure a database as a data source, click the ┇ menu and select "Add". Then choose "Database" from the list of source data types in the dropdown of the modal window, then click on the button labelled "Connect". This will open a Source Database detail page.

The Source Database Detail page shows the name of the resource along with a summary of the database characteristics (readability, number of columns detected) and allows the user to view and edit the parameters that describe how to access the data from the database, and to use these settings to analyse and preview the data.

If the IPT detects the number of columns in a mapped data source has changed when editing it, the user is warned that they should update its mappings.
IPTManageResourceSourceDatabase
  • Source Name - header, the name of the data source. Unlike a file data source, this can be edited and given any name by the user.

  • Source type - type of the source, SQL here.

  • Readable - this icon indicates whether data are accessible using the connection information provided on this page.

  • Analyse - (from Options dropdown) click on this button to generate a data summary based on the database connection settings on this page. The analysis will indicate whether the database is readable, and if so, how many columns there are in the results of the SQL Statement.

  • Preview - (from Options dropdown) click on this button to see an interpretation of the data based on the database connection settings on this page.

  • Database System - the relational database management system to which the IPT must connect to retrieve the data.

  • Host - The database server address, optionally including the non-default port number (e.g., localhost or mysql.example.org:1336). For ODBC connections, this is not needed.

  • Database - The name of the database in the database management system, or the DSN for an ODBC connection.

  • Database User - the name of the database user to use when connecting to the database.

  • Database Password - the password for the database user to connect to the database.

  • SQL Statement - The Structured Query Language statement used to read data from the source database. The statement will be sent as-is to the configured database, so you can use any native feature of the database such as functions, group by statements, limits, or unions, if supported. Example: SELECT * FROM specimen JOIN taxon ON taxon_fk = taxon.id. While testing a large data source it is a good idea to include the appropriate language in the SELECT statement to limit the number of rows returned by the query - for example, in MySQL, SELECT * FROM specimen JOIN taxon ON taxon_fk = taxon.id LIMIT 10. When the statement has been fully tested with the Darwin Core Mappings (see the following section), change the SQL Statement to return the full intended data set.

  • Character Encoding - the system that defines byte-wise definitions of the characters in the data (e.g., Latin1, UTF-8 ).

  • Date Format - a code describing the format of fields having a date data type (e.g., YYYY-MM-DD for four-digit year, two-digit month, and two-digit day separated by dashes).

  • Multi-value Delimiter - a single character that delimits the values in a multi-value field (e.g., | or ;).

After the parameters for the data source have been set so that the data are accessed correctly, click on the button labelled "Save" to store this configuration. If the save is successful, the Resource Overview page will appear, with summary information about the data in the right-hand column of the Source Data area. A button labelled "Edit" will also appear with the source data summary information, allowing the user to reopen the Source Database detail page.

URL as data source

The IPT can import uncompressed delimited text files (CSV, tab, and files using any other delimiter) or archives directly from a URL. Click the ┇ menu and select "Add". Then select "URL" from the source data type dropdown list, then provide source’s name and type or copy and paste the full URL (including http:// or https://) into the box below.

IPTManageResourceSourceSummary

Click on the button labelled "Clear" to remove the choice of URL and return to the previous state before any data source was selected. Or, click on the button labelled "Add" to open the Source Data URL detail page.

This page shows the name of the resource along with a summary of the URL characteristics (readability, number of columns detected, URL location, the number of rows detected, and the date the URL was last loaded into the IPT). The Source Data URL detail page allows the user to view and edit the parameters that describe the content of the selected file, and to use these settings to analyse and preview the file.

IPTManageResourceSourceURL

From this point, the process is very similar to using a file as a data source. See the File as data source section for an explanation of the page.

Darwin Core Mappings

This area of the Resource Overview page allows a user to map the fields in the incoming data to fields in installed extensions and to see which fields from the sources have not been mapped. This option is not available until at least one data source has been successfully added and at least one extension has been installed.

Once these conditions have been met, the dropdown will contain a select box with a list of Core Types and Extensions that have been installed. Select a Core Type and map that before selecting an extension to map. Select the appropriate extension that has fields matching the ones to map in the data source. If the appropriate core type or extension does not appear in the select box, it will have to be installed first. Refer to the information under the "Configure Core Types and Extensions" heading in the "Administration Menu" section for an explanation of how to install extensions.

IPTManageResourceDwCMapping

After the desired core type or extension is selected, click on the button labelled "Add" to open the Data Source selection page.

Data Source selection page

This page gives an explanation of the type of data the extension is meant to support, and shows a select box containing a list of all of the configured data sources.

A resource must only use 1 core type: choose "Darwin Core Checklist" when the basis of the resource is taxon names, or choose "Darwin Core Occurrence" when the basis of the resource is occurrences in nature (observations) or in a collection (specimens). Only after the desired core type has been mapped, will it be possible to map other extensions.
It is possible to map another core type as an extension as long as it is different from the core type mapped.
IPTManageResourceSourceSelect

Select the data source to map, and then click on the button labelled "Save". This will open the Data Mapping detail page (skip to the Data Mapping detail page below for help doing the actual mapping).

After a new mapping has been added, it will be visible in the Darwin Core Mappings area. This area will contain a list of all the resource’s mappings divided into Core Type mappings and Extension mappings. Click the item to modify it, or click the ┇ menu and select "Preview" to preview the mapping. Resource managers are advised to preview all mappings prior to publishing a new version.

IPTManageResourceDwCMapping2

Data Mapping detail page

After a mapping between a data source and Core Type or Extension has been created, this page opens and displays a status message showing how many fields from the data source were automatically mapped to the fields in the extensions. Fields are automatically mapped if the field names, converted to all lower case, match each other.

IPTManageResourceSourceMapping

The Data Mapping page allows a user to specify exactly how the data accessible through this IPT resource are to be configured based on the selected extension. At the top of the page is description of what extension the source data is being mapped to. The name of the source data is a link back to the edit source data page. The name of the extension is a link to a description of the extension.

A sidebar on the left-hand side of the page has links to jump to specific sets of related fields (classes/groups) in the extension plus filters to show and hide fields on the page.

To the right of the sidebar are rows of information divided into two columns of information; the first column (left-hand side) lists the names of fields in the extension; the second column (right-hand side) contains a set of controls (select boxes, text boxes) to set the value the extension field is supposed to contain. If a field name has been chosen in the source data field select box, text labelled "Source Sample" and a button labelled "Translate" will appear below it. Descriptions of the controls that may appear in the right-hand column of the data mapping table are given below:

  • Data source field select box - The left-hand select box is either blank or contains the name of a field from the data source. The IPT fills as many selections as it can from extension field names that match a data source field name. All of the remaining source field select boxes are left blank, signifying that the extension field has not been mapped to a source data field. If a field name is selected, the resource will use the value from that field in the source data as the value for the extension field in the Darwin Core Archive created by the IPT when the resource is published.

  • Data source field select box - ID field - This field can be matched to a source data field, or it can be set to "No ID" signifying that the field will not be mapped to a source data field. The ID field is required in order to link records from the two sources together. The ID can be auto-generated from the "Line Number" or "UUID Generator", but this feature is exclusively available when mapping a source to the Taxon Core Type’s taxonID field.

  • Constant value text box - To set the published value of any non-identifier extension field to a single value for every record in the data source, enter the desired constant for the extension field in the text box to the right of the source field select box. To activate the text box, make sure that no value is selected in the source field select box. Example:

IPTManageResourceMappingConstant
  • Constant controlled value select box - If the right-hand column for the extension field contains a second select box instead of a text box, this means that the field is governed by a controlled vocabulary. In this case, choose a value from the vocabulary list to use as a constant value in place of typing a constant into a text box.

IPTManageResourceMappingSelectConstant
  • Use resource DOI - (Special constant controlled value) It is possible to set the default value for datasetID equal to the resource DOI. This option only applies to extensions having the Darwin Core term datasetID, such as the Occurrence extension. To activate the checkbox, make sure that no source data field has been selected and no constant value has been entered.

IPTManageResourceMappingSourceDatasetID
  • Vocabulary detail button - Extension fields that are governed by a controlled vocabulary will have an icon beside the controlled value select box. Click on this icon to open a Vocabulary detail page in a new browser tab on which is a list of accepted values for the extension field with explanations and alternative synonyms in various languages.

  • Source Sample - This area shows actual values from the first five records of the selected field of the source data, separated by spaces and the character |. This helps the user understand if the contents of the source data field are appropriate for the extension field to which it has been mapped.

IPTManageResourceMappingSourceSample
  • Translate - Click on this button to open a Value Translation page on which distinct values in the selected field of the source data can be translated to new values in the archive generated by the IPT for this data resource. After the translations have been entered and saved, the Data Mapping page will appear again, and will display text as a link in place of the "Translate" button to show the number of values for which there are translations having values different from the original values. Click on this link to reopen the Value Translation page for this extension field.

  • Filter - The filter allows the user to include only records that match a criterion set for one of the source data fields. To use the filter, first select from the drop down whether you want the filter to be applied After Translation or Before Translation (in other words, after translations on the source data have been applied, or before - refer to Translation section above for more details about translation). Then, choose the field upon which the criterion will be based using the left select box. The text box at the right may contain a value against which to compare the value of the field in the source data. Do not enclose the value with any punctuation. The second select box allows the user to choose a comparison operator from among the following:

    • IsNull - this operator is true if the source data field is empty. In this case no value is needed in the text box at the right. If there is a value in the text box, it will be ignored.

    • IsNotNull - this operator is true if the source data field is not empty. In this case no value is needed in the text box at the right. If there is a value in the text box, it will be ignored.

    • Equals - this operator is true if the source data field is equal to the value in the text box at the right. Equality is evaluated based on string matching, thus, if the data source value for a record is 2.0 and the value in the text box is 2, the record will not be included in the filtered data set.

    • NotEquals - this operator is true if the source data field is not equal to the value in the text box at the right. Equality is evaluated based on string matching, thus, if the data source value for a record is 2.0 and the value in the text box is 2, the record will be included in the filtered data set.

    IPTManageResourceSourceFilter
    IPTManageResourceSourceFilterEquals
  • Required fields - If there are any required properties that must be mapped for the Core Type or Extension, these have their names highlighted. Be aware basisOfRecord publication will fail if basisOfRecord has not been mapped for the Occurrence core. Also, a special case exists for the ID field, which is only required when linking two sources together.

In addition to the explanatory information about the extension at the top of the page and the two columns described above, the Data Mapping page may have following sections, links, and buttons:

  • Resource Title - clicking on this link will navigate to the Resource Overview page without saving any of the pending changes.

  • Hide unmapped Fields - this filter/link will remove from view on this page all fields that have not yet been mapped, leaving only those with completed mappings. To view again those fields that have not been mapped, click on the "Show all" link.

  • Show all fields - this filter/link will make all fields visible, whether mapped already or not. This link appears only after the "Hide Unmapped Fields" link has been invoked.

  • Hide redundant classes - this filter/link will remove from view on this page all fields belonging to classes/groups of terms that are redundant. A class is redundant, if it is already included in the core extension. To view again those fields that belong to redundant classes, click on the "Show all classes" link. This link appears only after the "Show all classes" link has been invoked.

  • Show all classes - this filter/link will make all fields belonging to redundant classes/groups visible. This link appears only after the "Hide redundant classes" link has been invoked.

  • Save - clicking on any of the potentially many buttons labelled "Save" will change the pending changes on the page.

  • Delete - clicking this button will remove the entire mapping to a data source, not just the mapped fields, and return to the Resource Overview page.

  • Back - clicking on this button will abandon all changes that have been made on this page since it was last saved and return to the Resource Overview page.

  • Unmapped columns - this section contains a list of columns in the source file, table, or view that have not been mapped. This list can help to determine if everything from the source has been mapped that should be mapped.

    IPTManageResourceMappingUnmappedColumns
  • Redundant term classes - this section contains a list of classes whose terms are redundant, meaning that these classes already appear in the core extension. Ideally, a term that has been mapped in the core extension doesn’t need to be re-mapped again in an extension. Hiding redundant terms also has the additional benefit of making the mapping page easier to use for the user.

    IPTManageResourceMappingRedundantClasses

Value Translation page

When this page opens for the first time it shows a message at the top giving the number of distinct values of the selected field in the source data, up to 1000 values. The page shows the name and description of the extension field for which translations are being made. If the field is governed by a controlled vocabulary, information about that vocabulary and an icon to open a Vocabulary Detail page (see Vocabulary Detail button explanation, above) will appear under the field description. Below the field description is a table showing the distinct values of the field found in the source data under the column heading "Source Value" with text boxes under the column heading "Translated Value". Enter the value to which the Source Value should be translated in the text box. The icon to the left of the translated value text box indicates if the value provided exists in the vocabulary for this term.

IPTManageResourceSourceTranslation

Bounding the table above and below by the following set of buttons:

  • Save - click on this button to save all of the changes that have been made on this page and return to the Data Mapping page.

  • Delete - (from Options dropdown) click on this button to remove all translations for this field and return to the Data Mapping page.

  • Reload - (from Options dropdown) click on this button to search the source data again for distinct values. Existing translations are retained, and any new distinct values from the source data appear on the list without a translation.

  • Automap - (from Options dropdown) this button appears only if the field is governed by a controlled vocabulary. Click on this button to fill the Translated Values automatically with standard values based on known synonyms. Values in the source data for which there are no known synonyms will remain blank.

  • Cancel - click on this button to close the Value Translation page without saving any of the changes that have been made.

Vocabulary detail page

This page shows a list of concepts within the vocabulary. In the context of mapping data, it shows a list of accepted values that can be used for the extension field. Each concept may contain a description, its preferred synonyms (in various languages), plus any alternative synonyms (in various languages).

IPTManageResourceVocabularyDetail

Metadata

This area of the Resource Overview page allows a user to edit the resource metadata. To do this, click on the ┇ menu and select "Edit" in the dropdown. Every resource requires a minimal set of descriptive metadata in order to be published in the GBIF network, and if necessary assigned a DOI by GBIF. If any of the required metadata is missing, the Resource Overview page will open with a badge "Incomplete" in the Metadata area of the page.

IPTManageResourceMetadataMissing

An existing resource file can be uploaded, replacing any existing metadata. To do this, click the ┇ menu and select "Upload". Then click the "Browse" button and choose the EML file.

Clicking on the "Edit" option opens the Basic Metadata page, the first of a series of metadata pages. Each page will appear in sequence as the button labelled "Save" is clicked upon finishing entering data on any given metadata page. Saving the metadata on the last of the metadata pages will transition back to the Basic Metadata page. Clicking on the button labelled "Cancel" on any given metadata page will disregard any changes made on that page and return to the Resource Overview page. In a column at the left of each metadata page is a list of links to all of the metadata pages for easy reference and navigation. Click on any of the links to open the metadata page for that topic.

IPTManageResourceMetadataPagesList

Following is a list of the metadata pages and their contents:

Basic Metadata

All metadata fields on this page are required. Please note for each contact you must supply at least a last name, a position or an organization.

IPTManageResourceMetadataBasicMetadata
  • Title - the Title for the resource. This title will appear as the name of the resource throughout the IPT. The title will also appear in the GBIF Registry, and form part of the citation. Please use a descriptive title for users of the dataset. "Aves Tanzanian collection at the Natural History Museum of Denmark (SNM)" is a good title, "aves_tz_snm" is not! Avoid using filenames or acronyms known only within your organization.

  • Publishing Organization - the organization responsible for publishing (producing, releasing, holding) this resource. It will be used as the resource’s rights holder and publishing organization when registering this resource with GBIF and when submitting metadata during DOI registrations. It will also be used to auto-generate the citation for the resource (if auto-generation is turned on), so consider the prominence of the role. If the desired organization does not appear in the list it may be added by the IPT Administrator (see the information under the "Configure Organizations" heading in the "Administration Menu" section). Please be aware your selection cannot be changed after the resource has been either registered with GBIF or assigned a DOI.

  • Update Frequency - the frequency with which changes are made to the resource after the initial resource has been published. For convenience, its value will default to the auto-publishing interval (if auto-publishing has been turned on), however, it can always be overridden later. Please note a description of the maintenance frequency of the resource can also be entered on the Additional Metadata page.

  • Type - the type of resource. The value of this field depends on the core mapping of the resource and is no longer editable if the Darwin Core mapping has already been made. If a desired type is not found in the list, the field "other" can be selected. Review the information under the "Configure Core Types and Extensions" heading of the "Administration Menu" section.

  • Subtype - the subtype of the resource. The options for this field depend on the Type field. If a desired subtype is not found in the list, the field can be left with the default selection.

  • Metadata Language - the language in which the metadata are written.

  • Resource Language - the language in which the data for the resource are written.

  • Data License - the licence that you apply to the resource. The license provides a standardized way to define appropriate uses of your work. GBIF encourages publishers to adopt the least restrictive licence possible from among three (default) machine-readable options (CC0 1.0, CC-BY 4.0 or CC-BY-NC 4.0) to encourage the widest possible use and application of data. Learn more about GBIF’s policy here. If you feel unable to select one of the three options, please contact the GBIF Secretariat at participation@gbif.org. To find out how to apply a license at the record-level, refer to the How To Apply a License To a Dataset section. To find out how to change the IPT’s default set of licenses, refer to the Applying a License to a Dataset page in the IPT wiki.

  • Description - a brief overview of the resource broken into paragraphs. This should provide enough information to help potential users of the data to understand if it may be of interest.

  • Resource Contacts - the list of people and organizations that should be contacted to get more information about the resource, that curate the resource or to whom putative problems with the resource or its data should be addressed. The contacts in the list can be rearranged by simply dragging the elements and placing them in the right place.

    IPTManageResourceMetadataResourceContact
    • Copy from another - click on this link to copy contact data from any resource. A modal window is displayed with options to choose the resource and the contact.

    • Add new resource contact - click on this link to initiate a form for an additional resource contact.

    • Remove this resource contact - click on this link to remove the resource contact that follows immediately below the link.

    • First Name - the first or given name of the resource contact.

    • Last Name (required if Position and Organization are empty, required if the first name is not empty) - the last or surname of the resource contact.

    • Position (required if Last Name and Organization are empty) - the relevant title or position held by the resource contact.

    • Organization (required if Last Name and Position are empty) - the organization or institution with which the resource contact is associated. Though the organization may be one of those registered in the GBIF Registry, this is not required. Thus, the organization must be entered in the text box rather than selected from a list of registered organizations.

    • Address - the physical street or building address of the resource contact.

    • City - the city, town, municipality or similar physical location of the resource contact’s address.

    • State/Province - the state, province, or similar geographic region of the resource contact’s address.

    • Country - the name of the country or other first level administrative region of the resource contact’s address.

    • Postal Code - the postal code (e.g., zip code) of the resource contact’s address.

    • Phone - the preferred full international telephone number at which to reach the resource contact.

    • Email - the preferred email address at which to reach the resource contact.

    • Home Page - the URL to a worldwide web page for the resource contact.

    • Personnel Directory - the URL of the personnel directory system to which the personnel identifier belongs. There are four default directories to choose from: ORCID, ResearchID, LinkedIn, and Google Scholar. If you’d like to change the IPT’s default set of directories, refer to the Add a New User ID Directory page in the IPT wiki.

    • Personnel Identifier - a 16-digit ORCID ID (e.g. 0000-0002-1825-0097) or another identifier that links this person to the personnel directory specified.

  • Resource Creators - the people and organizations who created the resource, in priority order. The list will be used to auto-generate the resource citation (if auto-generation is turned on). If this person or organization is the same as the first resource contact, all of the details of the latter can be copied into the equivalent fields for the resource creator by clicking on the link labelled "copy details from resource contact". The resource creator has all of the same fields and requirements as the resource contact. Refer to the field explanations under Resource Contacts, above.

    the person(s) or organization(s) responsible for the creation of the resource as it appears in the IPT and for effectively publishing the resource can add themselves as an associated party with role 'publisher'.
  • Metadata Providers - the people and organizations responsible for producing the resource metadata. If this person or organization is the same as the first resource contact, all of the details of the latter can be copied into the equivalent fields for the resource creator by clicking on the link labelled "copy details from resource contact". The metadata provider has all of the same fields and requirements as the resource contact. Refer to the field explanations under Resource Contacts, above.

Geographic Coverage

This metadata page contains information about the geographic area covered by the resource. The page contains a map and associated controls that allow the user to set the geographic coverage. Below is a screen image showing the contents of the Geographic Coverage page, followed by explanations of the controls.

IPTManageResourceMetadataGeographicCoverage
  • Automatically infer from source data - source data would be analyzed and the geographical coverage would be set automatically on publication.

  • Preview inferred - analyze source data and display inferred values.

  • Coverage Map - if connected to the Internet, a map of the earth will appear on the geographic coverage page. This map shows a box with control points (markers) on all corners. The corners correspond with the values in the Latitude and Longitude text boxes, explained below. Drag the entire box, or drag individual markers to a new location to reset the geographic bounds of the box. The corresponding latitude and longitude values will change to match the box on the map. The map features hill shading, natural vegetation colours, advanced labelling, etc. The map has buttons to zoom in (+) and zoom out (-) and can be dragged in any direction to change the area of the earth being shown.

  • Set global coverage? - click on this check box to change the geographic coverage to cover the entire earth.

  • South/West & North/East - these four text boxes correspond to the SW and NE corners of the box bounding the area covered by the resource. The values to enter in these text boxes are decimal degrees (e.g. 45.2345), with the standard limiting values of -90 to +90 latitude (South/North) and -180 to +180 longitude (West/East), with positive latitude in the northern hemisphere and positive longitude east of the Greenwich Meridian to the International Dateline. Manipulating the bounding box markers on the map will set these values, but valid values can all be entered in these text boxes directly if desired. The map will update when the information on the page is saved by clicking on the button labelled "Save".

  • Description - a textual description of the geographic coverage. This information can be provided in place of, or to augment the information in the other fields on the page.

Taxonomic Coverage

This metadata page allows the user to enter information about one of more groups of taxa covered by the resource, each of which is called a taxonomic coverage. Each coverage consists of a description and list of taxa, where each taxon consists of a taxon name (either scientific or common) and a taxon rank. Before any taxonomic coverages are created, the page shows only a link labelled "Add new taxonomic coverage". Clicking on this link will show a text box for the description and several links. Below is a screen image showing the Taxonomic Coverage page before any data have been entered, followed by explanations of the controls seen on the page in this state.

IPTManageResourceMetadataTaxonomic
  • Automatically infer from source data - source data would be analyzed and the taxonomic coverage would be set automatically on publication.

  • Preview inferred - analyze source data and display inferred values.

  • Remove this taxonomic coverage - click on this link to remove the taxonomic coverage that follows immediately below the link, including the description, the list, and all single taxon entries.

  • Description - a textual description of a range of taxa represented in the resource. Each taxonomic coverage has its own description. This information can be provided in place of, or to augment the information in the other fields on the page.

  • Add several taxa - this link adds a text box labelled "Taxon List" to the page.

IPTManageResourceMetadataTaxonList
  • Taxon List - this text box allows the user to enter a list of taxa with each taxon on a separate line by using the ENTER key within the text box. The taxa entered in this list are treated as scientific names.

  • Add - this button processes the values entered in the Taxon List text box and creates scientific names for each of them within the taxonomic coverage.

  • Add new taxon - this link adds controls to enter a single taxon to the taxonomic coverage - text boxes for Scientific Name and Common Name, a select box for Rank and a "Remove this taxon" link. The taxon can contain any combination of scientific and common name with an optional rank.

IPTManageResourceMetadataSingleTaxon
  • Scientific Name - this text box is meant to contain the scientific name for the taxon.

  • Common Name - this text box is meant to contain the scientific name for the taxon.

  • Rank - this text box is meant to contain the taxonomic rank of the taxon.

  • Remove this taxon - clicking on this link will remove the taxon (scientific name, common name, and rank) to the left of the icon from the taxonomic coverage.

  • Add new taxonomic coverage - click on this link to initiate a form for a new taxonomic coverage with a text box labelled "Description" and links to "Add several taxa" and "Add new taxon" as described above.

Temporal Coverage

This metadata page contains information about one of more dates, date ranges, or named periods of time covered by the resource, each of which is called a temporal coverage. Coverages may refer to the times during which the collection or data set was assembled (Single Date, Date Range, and Formation Period), or to times during which the subjects of the data set or collection were alive (Living Time Period). Before the first temporal coverage for the resource is created, the page shows only a link labelled "Add new temporal coverage". Clicking on this link will show the default temporal coverage type "Single Date" in a select box, a text box labelled "Start Date", a calendar icon, and two links. Below is a screen image showing the default Temporal Coverage page before any data have been entered, followed by explanations of the controls seen on the page in this state.

IPTManageResourceMetadataTemporalCoverages
  • Automatically infer from source data - source data would be analyzed and the temporal coverage would be set automatically on publication.

  • Preview inferred - analyze source data and display inferred values.

  • Add new temporal coverage - click on this link to initiate a form for an additional temporal coverage.

  • Remove this temporal coverage - click on this link to remove the temporal coverage that follows immediately below the link.

  • Temporal Coverage Type - select one of the options in this select box to set the type of temporal coverage, which can consist of a single date, a date range, a formation period, or a living time period. Selecting a type will reveal controls appropriate to the choice as explained below.

    • Single Date - this is the default temporal coverage type showing when a temporal coverage is first created. This type is meant to represent a coverage spanning one day. Selecting this type reveals a text box for a Start Date, with a calendar icon to the right with which a date can be selected.

      • Start Date - this text box is meant to contain a single date in one of the supported date formats. To select a date, click on the calendar icon and choose a date, or enter the date manually. To find out what date formats are supported, open the information icon. Example: 2010-12-31 for 31 December 2010 in the New Era calendar.

        IPTManageResourceMetadataTemporalCoverageSingleDate
    • Date Range - this temporal coverage is meant to describe the time period within which the objects in the collection were collected. Selecting this temporal coverage type reveals a text box for a Start Date and a text box for an End Date, each with a calendar icon to the right with which a date can be selected.

      • Start Date - this text box is meant to contain the date the coverage began, in one of the supported date formats. To select a date, click on the calendar icon and choose a date, or enter the date manually. To find out what date formats are supported, open the information icon. Example: 2010-12-31 for 31 December 2010 in the New Era calendar.

      • End Date - this text box is meant to contain the date the coverage ended, in one of the supported date formats. To select a date, click on the calendar icon and choose a date, or enter the date manually. To find out what date formats are supported, open the information icon. Example: 2010-12-31 for 31 December 2010 in the New Era calendar.

        IPTManageResourceMetadataTemporalCoverageDateRange
    • Formation Period - this temporal coverage type is meant to accommodate a named or other time period during which a collection or data set was assembled. Examples: "Victorian", "1922-1932", "c. 1750".

      IPTManageResourceMetadataTemporalCoverageFormationPeriod
    • Living Time Period - this temporal coverage type is meant to accommodate a named or other time period during which the biological entities in the collection or data set were alive, including palaeontological time periods. Examples: "1900-1950", "Ming Dynasty", "Pleistocene".

      IPTManageResourceMetadataTemporalCoverageLivingTimePeriod

Keywords

This metadata page allows the user to create one or more sets of keywords about the resource. Each set of keywords can be associated with a thesaurus/vocabulary that governs the terms in the list.

IPTManageResourceMetadataKeywords
  • Remove this keyword set - click on this link to remove the keyword set that follows immediately below the link.

  • Thesaurus/Vocabulary - enter the name of a thesaurus or controlled vocabulary from which the keywords in the set are derived. If the keywords are not governed by a thesaurus/vocabulary, enter "n/a" indicating that it is not applicable in this text box. Example: IRIS keyword thesaurus.

  • Keyword List - enter a list of keywords, separated by commas that describe or are related to the resource.

  • Add new keyword set - click on this link to initiate a form for an additional keyword set.

Associated Parties

This metadata pages contains information about one or more people or organizations associated with the resource in addition to those already covered on the Basic Metadata page. Many of the controls on this page are in common with those for the Resource Contacts on the Basic Metadata page. Explanations for the remainder of the controls are given below.

IPTManageResourceMetadataAssociatedParties
  • Copy from another - if this person or organization is the same as the other contact of any resource, all of the details can be copied into the equivalent fields for the associated party by clicking on this link.

  • Remove this associated party - click on this link to remove the associated party that follows immediately below the link.

  • Role - this select box contains a list of possible roles that the associated party might have in relation to the resource. Click on the information icon to the left of the select box to see descriptions of the possible roles. Choose the most appropriate role for the associated party in the select box.

    • Author: an agent associated with authoring a publication that used the data set, or of a data paper

    • Content Provider: an agent who contributed content to a data set (data set being described may be a composite)

    • Custodian Steward: an agent who is responsible for/takes care of the data set

    • Distributor: an agent involved in the publishing/distribution chain of a data set

    • Editor: an agent associated with editing a publication that used the data set, or of a data paper

    • Metadata Provider: an agent responsible for providing the metadata (the same as metadata provider from basic metadata page

    • Originator: an agent who originally gathered/prepared the data set (the same as creator from basic metadata page)

    • Owner: an agent who owns the data set (may or may not be the custodian)

    • Point Of Contact: an agent to contact for further information about the data set

    • Principal Investigator: a primary scientific contact associated with the data set

    • Processor: an agent responsible for any post-collection processing of the data set

    • Publisher: the agent associated with publishing a publication that used the data set, or of a data paper

    • User: an agent that makes use of the dataset

    • Programmer: an agent providing informatics/programming support related to the data set

    • Curator: an agent that maintains and documents the specimens in a collection. Some of their duties include preparing and labelling specimens, so they are ready for identification, and protecting the specimens

    • Reviewer: person assigned to review the dataset and verify its data and/or metadata quality. This role is analogous to the role played by peer reviewers in the scholarly publication process.

  • Add new associated party - click on this link to initiate a form for an additional associated party.

Project Data

This metadata page contains information about a project under which the data in the resource were produced.

IPTManageResourceMetadataProjectData
  • Title - the title of the project.

  • Identifier - a unique identifier for the research project. This can be used to link multiple dataset/EML document instances that are associated in some way with the same project, e.g. a monitoring series. The nature of the association can be described in the project description.

  • Description - an abstract about the research project.

  • Funding - information about project funding and its sources (grant titles and numbers, contract numbers, names and addresses, active period, etc.). Other funding-related information may also be included.

  • Study Area Description - a description of the physical area where the project occurred (physical location, habitat, temporal coverage, etc.).

  • Design Description - a description of the design and objectives of the project. It can include detailed accounts of goals, motivations, theory, hypotheses, strategy, statistical design, and actual work.

  • Project Personnel - the list of people involved in the project.

    • Personnel First Name - the first name of the person associated with the project.

    • Personnel Last Name - the last name of the person associated with the project.

    • Personnel Directory - the URL of the personnel directory system to which the personnel identifier belongs. There are four default directories to choose from: ORCID, ResearchID, LinkedIn, and Google Scholar. If you’d like to change the IPT’s default set of directories, refer to the Add a New User ID Directory page in the IPT wiki.

    • Personnel Identifier - a 16-digit ORCID ID (e.g. 0000-0002-1825-0097) or another identifier that links this person to the personnel directory specified.

    • Personnel Role - the role of the person associated with the project. Click on the information icon to the left of the select box to see descriptions of the possible roles. Choose the most appropriate role in the select box for the person named above.

Sampling Methods

This metadata page contains information about sampling methods used for the data represented by the resource.

IPTManageResourceMetadataSamplingMethods
  • Study Extent - a description of the physical and temporal conditions under which the sampling occurred. The geographic study extent is usually a surrogate (representative area of) for the larger area documented in the "Study Area Description" field of the Project metadata page.

  • Sampling Description - a text-based/human readable description of the sampling procedures used in the research project. The content of this element would be similar to a description of sampling procedures found in the methods section of a journal article.

  • Quality Control - a description of actions taken to either control or assess the quality of data resulting from the associated method step(s).

  • Step Description - A method step is one in a series of repeated sets of elements that document a series of methods and procedures used in the study, and the processing steps leading to the production of the data files. These include text descriptions of the procedures, relevant literature, software, instrumentation, source data and any quality control measures taken. Each method should be described in enough detail to allow other researchers to interpret and repeat, if required, the study.

  • Add new method step - click on this link to add a text box labelled "Step Description" to the page (see above). One may add as many method steps as desired.

  • Remove this method step - click on this link to remove the method step text box that follows immediately below the link.

Citations

This metadata page contains information about how to cite the resource as well as a bibliography of citations related to the data set, such as publications that were used in or resulted from the production of the data. Each Citation, whether for the resource or in the bibliography, consists of an optional unique Citation Identifier allowing the citation to be found among digital sources and a traditional textual citation. Before any Citation data are entered, the page will show a text box for the Citation Identifier for the resource, a text box for the Resource Citation, a heading labelled "Bibliographic Citations", and a link labelled "Add new bibliographic citation".

IPTManageResourceMetadataCitations
Free-text citations get overwritten on the GBIF.org dataset page - learn more in the GBIF FAQ.
  • Resource Citation - the single citation for use when citing the dataset.

    • Example citation with institutional creator:

      Biodiversity Institute of Ontario (2011) Migratory birds of Ontario. Version 1.2. University of Guelph. Dataset/Species occurrences. https://doi.org/10.5886/qzxxd2pa

    • Example citation with 9 creators:

      Brouillet L, Desmet P, Coursol F, Meades SJ, Favreau M, Anions M, Belisle P, Gendreau C, Shorthouse D (2010) Database of vascular plants of Canada. Version 1.2. Universite de Montreal Biodiversity Centre. Dataset/Species checklist. https://doi.org/10.5886/1bft7W5f

  • Auto-generation - Turn On/Off - turn on to let the IPT auto-generate the resource citation for you. The citation format used in auto-generation is based on DataCite’s preferred citation format, and satisfies the Joint Declaration of Data Citation Principles. This format includes a version number, which is especially important for datasets that are continuously updated. You can read more about the citation format in the Dataset Citation Format page in the IPT wiki.

  • Citation Identifier - a DOI, URI, or other persistent identifier that resolves to the online dataset. It is recommended the identifier be included in the citation. If the resource has been assigned a DOI (using the IPT), the IPT sets the DOI as the citation identifier and it can no longer be edited.

  • Bibliographic Citations - the additional citations of other resources related to or used in the creation of this resource.

  • Add new bibliographic citation - click on this link to add the text boxes required for an additional citation in the bibliography.

    • Bibliographic Citation - the citation of an external resource related to or used in the creation of this resource.

    • Bibliographic Citation Identifier - a DOI, URI, or other persistent identifier that resolves to the online external resource. It should be used in the citation, usually at the end.

      IPTManageResourceMetadataBibCitations
    • Remove this bibliographic citation - click on this link to remove the citation that follows immediately below the link.

Collection Data

This metadata page contains information about the physical natural history collection associated with the resource (if any) as well as lists of types objects in the collection, called Curatorial Units, and summary information about them. Before any Collection data are entered, the page will show a header for each section (Collections, Specimen preservation methods, Curatorial Units) and a link labelled "Add new curatorial unit".

IPTManageResourceMetadataCollectionData
  • Collections - the list of collections that this resource is based on.

    • Add new citation - click on this link to add the text boxes required for an additional collection in the Collections section.

    • Collection Name - the full standard name by which the collection is known or cited in the local language.

    • Collection Identifier - The URI (LSID or URL) of the collection. In RDF, used as URI of the collection resource.

    • Parent Collection Identifier - Identifier for the parent collection for this sub-collection. Enables a hierarchy of collections and sub collections to be built. Please enter "Not applicable" if this collection does not have a parent collection.

    • Remove this collection - click on this link to remove the collection that follows immediately below the link.

      IPTManageResourceMetadataCollections
  • Specimen Preservation Methods - the list of specimen preservation methods covered by the resource, indicating the process or technique used to prevent physical deterioration of non-living collections. The values to choose from are based on the GBIF Specimen Preservation Method vocabulary. Remember you can include a list of preparations and preservation methods for a specimen in your data mapping DwC term preparations (http://rs.tdwg.org/dwc/terms/preparations). Please don’t select anything for treatments for living collections. This can relate to the curatorial unit(s) in the collection.

    • Add new preservation method - click on this link to add the text boxes required for an additional preservation method in the Specimen Preservation Methods section.

    • Remove this preservation method - click on this link to remove the preservation method that follows immediately below the link.

      IPTManageResourceMetadataPreservationMethods
  • Curatorial Units - the counts of curatorial units covered by the resource. The count can be entered as a range or as a value with an uncertainty. Examples of units include skins, sheets, pins, boxes, and jars. Overall, this section summarizes the physical contents of the collection by type.

    • Add new curatorial unit - click on this link to add the select text boxes required for an additional curatorial unit in the Curatorial Units section. When a new curatorial unit is added, the default Method Type selection is "Count Range".

    • Method Type - this select box allows the user to choose from among two methods to specify the number of objects of a given type, either a count range, or a count with uncertainty. After making the selection, appropriate text boxes will appear allowing that counting method to the represented.

      • Count Range - this method type allows the user to set the lower and upper bounds on the number of objects of a particular unit type. See screen image above.

        • Between - enter the lower bound of the number of objects in this text box.

        • and - enter the upper bound of the number of objects in this text box.

      • Count with uncertainty - this method allows the user to set a number of objects of a particular unit type with an uncertainty above or below that number.

        • Count - enter the mean likely number of object in this text box.

        • +/- - enter the number of objects more or less than the number in the count text box for the range of possible counts of the particular unit type

      • Unit Type - the single type of object (specimen, lot, tray, box, jar, etc.) represented by the method type and count.

    • Remove this curatorial unit - click on this link to remove the curatorial unit that follows immediately below the link.

      IPTManageResourceMetadataCuratorialUnits

This metadata page contains links to the home page for the resource as well as links to the resource in alternate forms (database files, spreadsheets, linked data, etc.) and the information about them. Before any external links are entered, the page will show a text box for the Resource Homepage and a link labelled "Add new external link".

IPTManageResourceMetadataExternalLinks
  • Resource Homepage - enter the full current URL of the web page containing information about the resource or its data set.

  • Other Data Formats - links to your resource data in other formats (e.g., database dumps, spreadsheets, nexus, linked data, etc.).

    • Add new external link - click on the link having this text to add the text boxes required for an additional external link.

    • Name - the name of the file or data set.

    • Character Set - the name or code for the character encoding (e.g., ASCII, UTF-8).

    • Download URL - the URL from which the file for the document or data set can be downloaded in the mentioned format.

    • Data Format - the name or code of the document or file format (e.g., CSV, TXT, XLS, Microsoft Excel, MySQL).

    • Data Format Version - the version of the document or file format given in the Data Format text box (e.g., 2003, 5.2).

    • Remove this external link - click on the link having this label to remove the external link that follows immediately below.

Additional Metadata

This metadata page contains information about other aspects of the resource not captured on one of the other metadata pages, including alternative identifiers for the resource. Before any alternative identifiers are entered, the page will show text boxes for the purpose, maintenance description, additional metadata, a header for the Alternative Identifiers area, and a link labelled "Add new alternative identifier".

IPTManageResourceMetadataAdditionalMetadata
  • Date Created - the date on which the first version of the resource was published. It will be used to formulate the publication year in the auto-generated resource citation. This value is set automatically when publishing and cannot be edited.

  • Date Published - the date when the resource was last published. This value is set automatically when publishing (see the Publication section).

  • Resource logo URL - a logo representing the resource. The logo URL can be used to upload the resource. It may also be uploaded from an image file selected from your disk.

  • Purpose - a summary of the intentions for which the data set was developed. Includes objectives for creating the data set and what the data set is to support.

  • Maintenance Description - a description of the maintenance frequency of this resource. This description compliments the update frequency selected on the Basic Metadata page.

  • Additional Information - any information that is not characterized by the other resource metadata fields, e.g. history of the project, publications that have used the current data, information on related data published elsewhere, etc.

  • Alternative Identifiers - this section contains a list of additional or alternative identifiers for the resource. When the resource is published, the IPT’s URL to the resource is added to the list of identifiers. If a resource is assigned a new DOI using the IPT, the IPT ensures this DOI is placed first in the list of identifiers. When a resource is registered with the GBIF Registry, the Registry’s unique resource key is also added to the list of identifiers. If the resource represents an existing registered resource in the GBIF Registry, the existing registered resource UUID can be added to the list of identifiers. This will enable the IPT resource to update the existing resource during registration, instead of registering a brand new resource. For more information on how to migrate a resource, see this section.

    • Add new alternative identifier - click on this link to add a text box for an alternative identifier for the resource.

    • Alternative Identifier - the text for the alternative identifier for the resource (e.g., a URL, UUID, or any other unique key value).

    • Remove this alternative identifier - click on this link to remove the alternative identifier that follows immediately below.

Publication

This area of the Resource Overview page allows a user to publish a version of the resource.

IPTManageResourcePublish

Click on the ┇ menu and select the "Publish" option to trigger publishing a new version. The "Publish" option will be enabled if

  1. the required metadata for the resource are complete, and

  2. the user has the role "Manager with/without registration rights".

Once the resource is registered only users with the role "Manager with registration rights" can publish, since the resource’s registration gets updated during each publication (see the explanation for Role in the "Create a new user" section under the "Configure User accounts" heading of the "Administration Menu" section). After pressing the "Publish" option, a confirmation dialog will appear:

IPTManageResourcePublishConfirm

The resource manager should enter a summary of what changes have been made to the resource (metadata or data) since the last/current version was published. The change summary is stored as part of the resource version history, and can be edited by resource managers via the resource homepage. A complete description of what happens after pressing "Publish" is explained in the "Publishing steps" section below.

IPTManageResourcePublish
Figure 1. A pending publication:

Shown here is table that compares the current version against the pending version. Resource managers can use this table to manage resource versioning, preview the pending version, plus review and validate the current version. The data in the table includes:

  • Version - the version number tracking the major_version.minor_version of the current/pending version. This is usually relevant only if you use the IPT-issued DOI workflow.

  • Current - current already published version.

  • Pending - next version.

  • License - resource license (e.g. CC0 1.0).

  • DOI - see DOI Workflows if IPT-issued DOIs is enabled.

  • Visibility - the visibility of the current/pending version. In order to register the resource with GBIF, the resource manager must ensure the current version is public.

  • Published on - to date the current version was published on / the date the pending version will be published on.

  • Publication log - button. Click to retrieve the "publication.log" of the current version. The resource manager can use the publication log to diagnose why publication failed for example. A more detailed description of its contents is described below in the Publishing Status page section. This is not applicable to the pending version.

Publishing steps

The publish action consists of the steps described below. Publication is all or nothing meaning that each step must terminate successfully in order for a new version to be published. If any step fails, or if the publish action is cancelled, the version is rolled back to the last published version.

  1. The current metadata are written to the file eml.xml. An incremental version named eml-n.xml (where n is the incremental version number reflecting the publication version) is always saved.

  2. A data publication document in Rich Text Format (RTF) is written to the file shortname.rtf. An incremental version of the RTF file named shortname-n.rtf is always saved.

  3. The current primary resource data as configured through mapping are written to the Darwin Core Archive file named dwca.zip. The data files in the Darwin Core Archive are then validated (see "Data Validation" section below).

  4. If the IPT’s Archival Mode is turned on (see Configure IPT settings section), an incremental version of the Darwin Core Archive file named dwca-n.zip is also saved.

  5. The information about the resource is updated in the GBIF Registry if the resource is registered.

  6. The DOI metadata about the resource is updated and propagated to DOI resolvers if the resource is assigned a DOI using the IPT.

Data Validation

The IPT writes data files inside the DwC-A as tab delimited files void of line breaking characters (note: line breaking characters found in the original data are replaced with an empty string).

After writing, the IPT also validates their content in the following ways:

  • If a column representing the core record identifier (e.g. occurrenceID is the core record identifier of the Occurrence core) is found in the core data file, the IPT will validate that for each record, the core record identifier is present, and unique.

  • The Darwin Core term basisOfRecord is a required term in the Occurrence extension. Therefore the IPT validates that each Occurrence data file has a basisOfRecord column. In addition, the IPT validates that for each Occurrence record the basisOfRecord is present, and its value matches the Darwin Core Type vocabulary.

Publishing Status page

A page entitled Publishing Status will show status messages highlighting the success or failure of each publishing step. Publication of a new version is an all or nothing event, meaning that all steps must finish successfully otherwise the version is rolled back.

  • Resource overview - This link leads to the Manage Resource page for the resource just published.

  • Publication log - This link initiates a download of a file named "publication.log", which contains the detailed output of the publication process. This file contains specific information to help managers identify problems during publication such as:

    • how many records couldn’t be read and were not written to the DwC-A

    • how many records were missing an identifier, or how many had duplicate identifiers (in the case that the core record identifier field was mapped)

    • how many records contained fewer columns than the number that was mapped

  • Log message - The Publishing Status page shows a summary of the information that was sent to the filed named publication.log, which is stored in the directory for the resource within the IPT’s data directory and which is accessible through the link to the "Publication Log" immediately above the log message summary.

IPTManageResourcePublishingStatus

Auto-publishing

To turn on automated publishing, in the Auto-publishing section click the ┇ menu and select "Edit".

IPTManageResourceAutoPublishingStatus

Select one of the 5 publishing intervals (annually, biannually, monthly, weekly, or daily) and choose a time, then press "Save".

IPTManageResourceAutoPublishingSetup

When automated publishing is on, the publishing interval and next published date are clearly displayed in the auto-publishing section. The "Edit" option can be used to change or disable auto-publishing.

In case of failure, publishing will be retried automatically up to 3 more times. This safeguards against infinite publishing loops. Resources configured to publish automatically, but that failed to finish successfully will have a next publication date in the past, and will be highlighted in the public and manage resource tables.

Visibility

The Visibility area of the Manage Resources page allows users having manager rights for the resource to change its visibility state. The visibility of a resource determines who will be able to view it, and whether the resource can be registered with GBIF. By default, each resource is visible only to the user who created it and any other users who have the Admin role on the IPT where the resource is created. For explanations of each visibility state refer to the information below.

  • Private - A private resource is visible only to those who created it, or those who have been granted permission to manage it within the IPT, or by a user having the Admin role. This is primarily meant to preserve the resource from public visibility until it has been completely and properly configured.

    IPTManageResourceVisibilityPrivate

    When the resource is ready for public visibility, click on the ┇ menu and select the option labelled "Change". This will display a modal window with two options. You can make the resource public right away or at a set date

    IPTManageResourceVisibilityMakePublic1
    IPTManageResourceVisibilityMakePublic2

    After submitting the form a message will appear at the top of the page saying that the status has been changed to "Public".

  • Public - A public resource is visible to anyone using the IPT instance where the resource is installed (on the table of public resource on the IPT Home page). The resource is ultimately accessible via the Internet to anyone who knows its homepage URL. However, the resource is not globally discoverable through the GBIF website until it has been registered with the GBIF Registry (see Registration).

    IPTManageResourceVisibilityPublic

    One option appear in the ┇ menu of the visibility area. Clicking on the option labelled "Change" will display a modal window

    IPTManageResourceVisibilityMakePrivate

    Clicking on button labelled "Yes" will remove the resource entirely from public visibility and return it to the private state.

  • Registered - A resource that has been registered with the GBIF network is discoverable through the GBIF website and the data from the resource can be indexed by and accessed from the GBIF portal. Be aware it can take up to one hour for data to be indexed by GBIF following registration. A summary of information registered with GBIF will appear in the Registration area when registration is complete.

    IPTManageResourceVisibilityRegistered

    If the resource has already been registered, every time the "Publish" button is clicked, its registration information in the GBIF Registry also gets updated. The visibility of a registered resource can not be changed to private. If a resource must be removed from the GBIF Registry, follow the procedure described in the "Delete a Resource" section under the "Resource Overview" heading in the "Manage Resources Menu" section.

Registration

The resource is not globally discoverable through the GBIF website until it has been registered with the GBIF Registry.

IPTManageResourceRegistration

Registration is enabled when:

  1. the required metadata for the resource are complete,

  2. the resource has been published (see the explanation of the Publication area of the Resource Overview page, below), and

  3. the user has the role "Manager with registration rights" (see the explanation for Role in the "Create a new user" section under the "Configure User accounts" heading of the "Administration Menu" section). A user having the Admin role can grant the "Manager with registration rights" to any user.

Click on the ┇ menu and select the option labelled "Register" to register the resource with the GBIF Registry.

If you want this resource to update an existing registered DiGIR, BioCASe, or TAPIR resource, please refer to the section Migrate a Resource below

Clicking on this option will open a dialog box with which to confirm that you have read and understood the GBIF data sharing agreement, to which a link is given. Click on the check box to indicate that you agree with these terms. Doing so will cause a button labelled "Yes" to appear at the bottom of the dialog box. Click on "Yes" to register the resource, or click on "No" to defer the decision and close the dialog box.

IPTManageResourceVisibilityRegisterAgreement

If the attempt to register is successful, a message will appear at the top of the page saying that the status has been changed to "Registered". Registration section when the resource is registered:

IPTManageResourceVisibilityRegistered

Networks

This section allows the resource to be included in one or more GBIF networks — collections of datasets potentially from many publishers, usually on a single theme. The largest network in GBIF is the Ocean Biodiversity Information System (OBIS).

IPTManageResourceNetworks

To add the resource to a network, click on the ┇ menu and select the "Add" option. To remove it, click the ┇ menu on the network item and select "Delete".

Please only add your resource to a network with the approval of the network managers or the GBIF Help Desk.

Resource Managers

IPTManageResourceManagers

Each resource has one or more explicitly assigned managers who are allowed to view, change, and remove the resource. The user who creates a resource automatically has these capabilities. Additional managers can be associated with a resource and given these same capabilities by selecting them by name from the select box in this area of the Resource Overview page, then clicking on the ┇ menu and selecting option labelled "Add". Any manager associated with a resource and having the role "Manager with registration rights" may also register the resource and update it in the GBIF registry. All users having the Admin role automatically have complete managerial roles for all resources in the IPT instance. The area shows the name and email address of the creator of the resource. If any managers have been added, their names and email addresses will be listed under the creator. Any added manager can have the managerial role for the resource removed by clicking on the respective ┇ menu and selecting the option labelled "Delete".

IPTManageResourceManagerAdded

Delete a Resource

Clicking on the button labelled "Delete" on the Resource Overview page will display a modal confirmation window.

IPTManageResourceDelete

For registered with GBIF resources, it will display a modal window with two options.

IPTManageResourceDeleteRegistered
  • Delete from the IPT and GBIF.org

  • Delete from the IPT only (Orphan)

Either options will remove the resource from the IPT and all of the related documents from the file system. The first will also delete the resource from GBIF.org.

Before deleting the resource, you can make a copy of the data in case you wish to restore it later. To do this, look on the server inside the IPT’s data directory, in the "resources" directory. Copy the directory (with the short name for the resource) to safe storage, somewhere outside the IPT’s data directory. A resource saved in this way can be re-integrated into the IPT, or integrated with a different IPT instance by following the procedure described in the "Integrate an existing resource configuration folder" section under the "Create a New Resource" heading in the "Manage Resources Menu" section.

Migrate a Resource

There is now a way to migrate existing registered DiGIR, BioCASe, TAPIR, or DwC-A resources to an IPT. This allows the existing resource to preserve its GBIF Registry UUID.

The way this works, is that the IPT resource is configured to update the existing registered resource that it corresponds to in the GBIF Registry.

To migrate an existing registered resource to your IPT resource, follow these instructions:

  1. Ensure that the IPT resource’s visibility is public and NOT registered.

  2. Determine the owning organization of the existing registered resource, ensure that it is added to the IPT as an organization, and that it is configured to publish datasets. To do so, please refer to the Add Organization section.

  3. Select the owning organization from the drop-down list on the Basic Metadata page. Don’t forget to save the Basic Metadata page.

  4. Go to the GBIF Dataset page of the existing registered resource. Depending on whether you are running the IPT in test or production mode, you would visit https://www.gbif-uat.org/dataset or https://www.gbif.org/dataset respectively.

  5. Ensure the GBIF Dataset page shows the correct owning organization of the existing registered resource.

    if it shows a different owning organization, the GBIF Registry must be updated before you can proceed with the remaining steps. Send an email to helpdesk@gbif.org alerting them to the update needed.
  6. Copy the GBIF Registry UUID from the GBIF Dataset page URL, e.g 5d637678-cb64-4863-a12b-78b4e1a56628.

  7. Add this UUID to the list of the IPT resource’s alternative identifiers on the Additional Metadata page. Don’t forget to save the Additional Metadata page.

  8. Ensure that no other public or registered resource in your IPT includes this UUID in their list of alternative identifiers. In cases where you are trying to replace a registered resource that already exists in your IPT, the other resource has to be deleted first.

  9. On the resource overview page, click the register button. Similar to any other registration, you will have to confirm that you have read and understood the GBIF data sharing agreement before the registration will be executed.

    You will receive a confirmation message like this, showing the existing dataset in GBIF has been updated.

    IPTManageResourcePublishOverwrite
  10. If applicable, email helpdesk@gbif.org alerting them whether the DiGIR/BioCASe/TAPIR/IPT technical installation that used to serve the resource has been deprecated, and whether it can be deleted from the GBIF Registry