Dataset Work Type

About

This work type represents datasets from our institutional repository. Datasets have 1-n files and each may be open or restricted from public access.

Datasets are different from other works and deserve there own worktype in order to be included in Google’s Dataset Search.

Example Dataset

For this example, let’s use https://trace.tennessee.edu/utk_datasets/1.

In Digital Commons, no files are currently managed, but in Trace Deposit there are several files and an original metadata. Datasets in Trace Deposit are compound objects with the metadata record attached to the compound object and 1 to many binary objects that belong the the compound object. In this instance:

Compound object: https://trace.utk.edu/islandora/object/utk.ir.fg%3A18
Binary object: https://trace.utk.edu/islandora/object/utk.ir.fg%3A15
Binary object: https://trace.utk.edu/islandora/object/utk.ir.fg%3A16
Binary object: https://trace.utk.edu/islandora/object/utk.ir.fg%3A17

For migration, we want to move the metadata from the compound object and each binary object.

Suggested PCDM Model for Fedora

A dataset can have 1-n files and they should all be treated as original files and preserved.

The Whole Work

The object should be a pcdmworks:Work and describe its relationship to its files along with its descriptive metadata elements.

@prefix pcdm: <http://pcdm.org/models#> .
@prefix pcdmuse: <http://pcdm.org/2015/05/12/use> .
@prefix pcdmworks: <http://pcdm.org/2016/02/16/works> .

<http://localhost/sample-dataset> a pcdmworks:Work ;
    <http://purl.org/dc/terms/title> "Competing magnetostructural phases in a semiclassical system" ;
    pcdm:hasFile <http://localhost/sample_dataset_file_1> .

The Original Uploaded File

The original uploaded file(s) representing this work should be pcdmuse:OriginalFile.

@prefix pcdm: <http://pcdm.org/models#> .
@prefix pcdmuse: <http://pcdm.org/2015/05/12/use> .
@prefix pcdmworks: <http://pcdm.org/2016/02/16/works> .

<http://localhost/dataset_file_1> a pcdmuse:OriginalFile ;
    rdfs:label "sample.csv" ;
    pcdm:fileOf <http://localhost/sample-dataset> .

Google Dataset Inclusion

Datasets should not go to Google Scholar, but should go to Google Dataset Search.

Unlike Google Scholar, Google Dataset Search relies on a structured body via a Schema.org mapping in a script tag in the head of the document.

Our metadata mapping will include this conversion for this worktype.

Descriptive Metadata Mapping

Name	Display Label	Property	Description	Required	Obligation	Admin only	Facetable	Brief Results	Vocab	Syntax	JSON LD
abstract	Abstract	http://purl.org/dc/terms/abstract	A summary of the resource.	Optional	0-n	no	no	yes	none		description
classification	Classification	https://dbpedia.org/ontology/classification	A string representing a class or category the resource is assigned to for browsing purposes	Required	1	no	yes	no	local yml file
college	College	https://dbpedia.org/ontology/college	The college associated with the resource’s creator.	Optional	0-n	no	yes	no	local yml file
data_collection_location	Data Collection Location	http://purl.org/dc/terms/spatial	A single point that describes where all the measurements or data was collected.	Optional	0-1	no	no	no	Geonames		“spatialCoverage : { “@type”: “Place”, “name”: “String of place name that correlatesto GeoCoordinates”, “geo”: { “@type”: “GeoCoordinates”, “latitude”: 39.3280, “longitude”: 120.1633 } }
data_collection_period	Data Collection Period	http://id.loc.gov/ontologies/bibframe/capture	The period in which the data from a dataset was collected. Use ISO 8601 date syntax. Use single dates: “2008”. If the date consists of multiple years, repeat this element.	Optional	0-2	no	no	no	none	ISO-8601	temporalCoverage
discipline	Discipline	http://dbpedia.org/ontology/academicDiscipline	A concept that identifies a field of knowledge or human activity defined in a controlled vocabulary, such as Computer Science, Biology, Economics, Cookery or Swimming.	Required	1-n	no	yes	no	local yml file
doi	DOI	http://purl.org/ontology/bibo/doi	A DOI (Digital Object Identifier), a unique identifier for this resource.	Optional	0-1	no	no	no	none	DOI syntax	@id, identifier
funders	Funding Agency	http://purl.org/cerif/frapo/hasFunderIdentifier	An organization that provides financial support for this dataset. To aid in discovery in Google Dataset Search, use ROR id to uniquely identify the supporting institution or organization.	Optional	0-n	no	no	no	ROR ID (https://github.com/ror-community/ror-api)	ROR ID	“funder: { “@type”: “Organization”, “sameAs”: “http://ror.org/yyyyyyyyy”, “name”: “Fictitious Funding Organization” }
grant_number	Grant Number	http://purl.org/cerif/frapo/hasGrantNumber	The grant number that provides unique identification for the grant	Optional	0-n	no	no	no	none		identifier
keywords	Keyword	https://w3id.org/idsa/core/keyword	Keywords that describe the nature, purpose, or use of the content.	Optional	0-n	no	no	no	none		keywords
license	License	http://purl.org/dc/terms/license	A license under which the dataset is distributed.	Optional	0-1	no	no	no	Creative Commons or Creative Commons yml file	https://creativecommons.org/publicdomain/zero/1.0/	license
notes	Note	http://www.w3.org/2004/02/skos/core#note	A general note, for any purpose.	Optional	0-n	no	no	no	none
orcidID	Orcid ID	http://purl.org/cerif/frapo/hasORCID	An ORCID identifier (not the URL) of a researcher	Optional	0-n	no	no	no	ORCID	ORCID URL	creator.sameAs with the researcher’s name string as creator.name
related_articles	Related Article	http://purl.org/cerif/frapo/hasOutput	DOIs that identify academic articles that are recommended by the data provider be cited in addition to the dataset itself.	Optional	0-n	no	no	no	none	DOI	citation
contributor	Contributor	http://id.loc.gov/vocabulary/relators/ctb	A person responsible for performing research associated with this dataset.	Required	1-n	no	no	yes	none		creator.name with the researchers ORCiD as creator.sameAs
subject	Subject	http://purl.org/dc/terms/subject	A topic of the resource.	Optional	0-n	no	yes	no	FAST
date_submission	Submission Date	http://purl.org/dc/terms/dateSubmitted	Date of submission of the resource.	Required	1	no	no	no	none	ISO-8601
title	Title	http://purl.org/dc/terms/title	A name given to the resource.	Required	1	no	no	yes	none		name
type	Type	http://www.europeana.eu/schemas/edm/hasType	This property relates a resource with the concepts it belongs to in a suitabletype system such as MIME or any thesaurus that captures categories ofobjects in a given field (e.g., the “Objects” facet in Getty’s Art andArchitecture Thesaurus). It does not capture aboutness.	Required	1-n	no	yes	no	no
language	Language	http://purl.org/dc/terms/language	The language of the resource.	Optional	0-n	no	no	no	local yaml or ISO 639-1 list	ISO 639-1 two-letter code

UTK Requested Mapping

NOTE: our mapping is intentionally simple compared to others

No funders, spatial data, or orcids are here due to missing metadata.

{
    "@context": "http://schema.org/",
    "@type": "Dataset",
    "@id": "https://doi.org/10.7290/xM68gPMMvQ",
    "name": "Influence of Flocculant on Flow Behavior and Undrained Shear Strength of Fine Coal Refuse",
    "description": "This data set is in support of a manuscript submitted accepted for publication in the journal Fuel. The purpose of this study is to investigate the effect of an added flocculant on the flow behavior and undrained shear strength of fine coal refuse (FCR) from an active impoundment in eastern Kentucky. The specimens were formed from fresh FCR slurry samples obtained from a slurry discharge pipe, as well as solids recovered from the same fresh FCR mixed with either distilled water or a sodium hexametaphosphate dispersant solution. The specimens were consolidated in columns over a range of low stresses to create soft, relatively low strength specimens. Specimens were prepared with different initial void ratios and moisture contents. Flow table tests and vane shear strength tests were performed to investigate the influence of the background solution type on the flow behavior and undrained shear strength.",
    "url": "https://our-future-repo.ir.utk.edu/datasets/sample/1",
    "identifier": "https://doi.org/10.7290/xM68gPMMvQ",
    "isAccessibleForFree": true,
    "keywords": ["fine coal refuse", "flow table", "undrained shear strength", "flocculant", "dispersant"],
    "creator": [{ "@type": "Person",
                      "name": "Angelica M. Palomino"},
                { "@type": "Person",
                      "name": "Cyrus Jedari"},
        ],
      "temporalCoverage": [
        "2017-05-01",
        "2018-04-30"
      ],
    "citation": "https://doi.org/10.7302/s3nc-wh40",
    "license":
      {"@type": "CreativeWork",
       "name": "Attribution 4.0 International (CC BY 4.0)",
       "license": "http://creativecommons.org/licenses/by/4.0/"},
    "publisher":
      {"@id": "https://our-future-repo.lib.utk.edu/data",
       "@type": "Organization",
       "legalName": "University of Tennessee, Knoxville",
       "name": "Data Repository",
       "url": "https://our-future-repo.lib.utk.edu/data/"}
}

For UTK Faculty and Staff Only

Should datasets be in there own tenant?

Arguably, yes. The primary purpose of treating datasets as its own worktype is to enable dataset sharing in Google Dataset Search. Google Dataset Search has a different inclusion methodolgy than Google Scholar that more resembles standard indexing practices. In addition to requirements for JSON-LD or rdfa, this requires a sitemap with proper canonical tagging, and the sitemap should describe only the datasets. Therefore, having a separate tenant makes things easier.

That being said, it is important to remember that we have very few datasets, and we don’t have clear direction or policies for our approach to taking datasets in the future.

A potential workaround for including datasets in our planned tenant then is to simply create a small feature that queries our instance for dataset works and generate a separate sitemap around those. The works described in the sitemap should all have proper JSON-LD or rdfa.

Migration Scope

Datasets in Digital Commons are currently metadata only objects that reference Trace Deposit.

Datasets are in two series (collections):

utk_datasets
utk_geogpubs

Currently, these are our list of datasets:

utk_datasets/14/metadata.xml
utk_datasets/15/metadata.xml
utk_datasets/16/metadata.xml
utk_datasets/17/metadata.xml
utk_datasets/18/metadata.xml
utk_datasets/19/metadata.xml
utk_datasets/20/metadata.xml
utk_datasets/21/metadata.xml
utk_datasets/23/metadata.xml
utk_datasets/24/metadata.xml
utk_datasets/25/metadata.xml
utk_datasets/26/metadata.xml
utk_datasets/27/metadata.xml
utk_datasets/28/metadata.xml
utk_datasets/29/metadata.xml
utk_datasets/30/metadata.xml
utk_geogpubs/30/metadata.xml

Using a bit of sparql, we can determine what our list of datasets in Digital Commons should be:

PREFIX rels-ext: <info:fedora/fedora-system:def/relations-external#>
PREFIX model: <info:fedora/fedora-system:def/model#>
SELECT $pid FROM <#ri> WHERE {{
?pid rels-ext:isMemberOfCollection <info:fedora/utk.ir:fg>;
model:hasModel <info:fedora/islandora:compoundCModel> ;
model:label ?label . }}

That returns these results:

{
  "results": [
    {
      "pid": "info:fedora/utk.ir.fg:7",
      "label": "Data from Tasmanian Eucalyptus Plant Functional Trait and Herbivory Data"
    },
    {
      "pid": "info:fedora/utk.ir.fg:14",
      "label": "Data from The State of Social Media Policies in Higher Education"
    },
    {
      "pid": "info:fedora/utk.ir.fg:18",
      "label": "Data from Public Progress, Data Management and the Land Grant Mission"
    },
    {
      "pid": "info:fedora/utk.ir.fg:27",
      "label": "Data Used in Carter et al., Exotic Plants and Thermal Regimes, Functional Ecology"
    },
    {
      "pid": "info:fedora/utk.ir.fg:29",
      "label": "Data from NSF Award #1155339: Governance of International Labor Migration: Scalar Politics and Network Relations"
    },
    {
      "pid": "info:fedora/utk.ir.fg:101",
      "label": "Data from Interpretations of NASA’s MSL Dynamic Albedo of Neutrons Passive Mode Data"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2090",
      "label": "Voices of Diversity"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2099",
      "label": "Data from New Age Estimates and Microscopic Charcoal Data for the 1976-B Core from Anderson Pond, Tennessee, USA"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2110",
      "label": "Data for Investigating the effect of metal powder recycling in Electron beam Powder Bed Fusion using process log data"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2112",
      "label": "Data for Investigating the effect of metal powder recycling in Electron beam Powder Bed Fusion using process log data"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2129",
      "label": "Data from Near-field infrared spectroscopy of monolayer MnPS3 (OBJ file)"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2132",
      "label": "Spectroscopic studies of size-dependent optical properties of oxide nanomaterials, molecule-based materials in extreme condition"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2162",
      "label": "Data from Host density and habitat structure influence host contact rates and Batrachochytrium salamandrivorans transmission"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2176",
      "label": "Data from Mental Health, Weather Extremes, and Race study"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2179",
      "label": "Data from American Astronomical Society Survey"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2188",
      "label": "Data from The National Electronic Library - User questionnaire for universities 2007 (Finland)"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2193",
      "label": "Data for Database Use Patterns in Academic and Public Libraries"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2198",
      "label": "Data from Database Marketplace Survey 2000"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2215",
      "label": "Data Fitness for Use - INTERVIEWS"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2239",
      "label": "Data for Soil nematode functional diversity, successional patterns, and indicator taxa associated with vertebrate decomposition"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2245",
      "label": "Data from Business Journals Data Sharing"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2248",
      "label": "Job analyses of earth science data librarians and data managers"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2263",
      "label": "Data from \"Traditional rural values and posttraumatic stress among rural and urban undergraduates\""
    },
    {
      "pid": "info:fedora/utk.ir.fg:2268",
      "label": "Experimental methodologies can affect pathogenicity of Batrachochytrium salamandrivorans infections."
    },
    {
      "pid": "info:fedora/utk.ir.fg:2273",
      "label": "Data Management Plan Compliance and Evaluation"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2287",
      "label": "Data Fitness for Use - SURVEYS"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2290",
      "label": "Data Services Librarians"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2303",
      "label": "GSSE Water Quality 2020"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2307",
      "label": "Influence of Flocculant on Flow Behavior and Undrained Shear Strength of Fine Coal Refuse"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2311",
      "label": "Winter is Coming – Temperature Affects Immune Defenses and Susceptibility to Batrachochytrium salamandrivorans"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2341",
      "label": "Frequency-dependent transmission of Batrachochytrium salamandrivorans in eastern newts"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2355",
      "label": "Nitrogen-cycle genes and transcripts abundances under agricultural management practices in a long-term continuous cotton field"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2360",
      "label": "Data for Broad host susceptibility of North American amphibian species to Batrachochytrium salamandrivorans"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2381",
      "label": "Survey Validation of Job Analyses for Science Data Managers"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2384",
      "label": "Alabama Taxation and Changing Discourse from Reconstruction to Redemption"
    },
    {
      "pid": "info:fedora/utk.ir.fg:2385",
      "label": "Alabama Taxation and Changing Discourse from Reconstruction to Redemption"
    }
  ]
}

Suggested Actions

If an object in Digital Commons refers to a object on trace.utk.edu that is not an ETD, we will migrate the object into the new repository as a dataset. It cannot stay at trace.utk.edu for security reasons.
If an object is in Trace Deposit and not an ETD, we will migrate it to the new system as a dataset.
We will provide the vendor for migration pages with front matter but without the coverpage.
The vendor will build a feature to add the appropriate cover page.
The vendor will build a feature for front matter going forward.

Sample Deep Blue DataSet

This is a sample dataset from Deep Blue to aid in mapping:

{
    "@context": "http://schema.org/",
    "@type": "Dataset",
    "@id": "https://doi.org/10.7302/s3nc-wh40",
    "name": "Data for &quot;Metropolitan air pollution abatement &amp; industrial growth: Global urban panel analysis of PM2.5, PM10, SO2 and NO2&quot;",
    "description": ["Data were gathered to test three hypotheses on the impact economic growth has on environmental conditions in urban areas. The three hypotheses are: 1. Income will be associated with reductions in PM2.5, PM10, NO2 and SO2. 2. Public Administration GVA will be associated with reductions in PM2.5, PM10, NO2 and SO2. 3. Urban density will be associated with reductions in PM2.5, PM10, NO2 and SO2. More information about the research and the data can be found in: Benjamin Leffel, Nikki Tavasoli, Brantley Liddle, Kent Henderson &amp; Sabrina Kiernan (2021) Metropolitan air pollution abatement and industrial growth: Global urban panel analysis of PM10, PM2.5, NO2 and SO2, Environmental Sociology, DOI: 10.1080/23251042.2021.1975349. "],
    "url": "https://deepblue.lib.umich.edu/data/concern/data_sets/d217qp73w",
    "identifier": "https://doi.org/10.7302/s3nc-wh40",
    "isAccessibleForFree": true,
    "keywords": ["global cities","environment","urban","air pollution","income","Urban Sustainability Research Group","student-friendly"],
    "creator": [{ "@type": "Person",
                      "name": "Benjamin Leffel"}],
      "temporalCoverage": [
        "2005",
        "2017"
      ],
    "citation": "Benjamin Leffel. (2022). Data for &quot;Metropolitan air pollution abatement &amp; industrial growth&#58; Global urban panel analysis of PM2.5, PM10, SO2 and NO2&quot [Data set], University of Michigan - Deep Blue Data. https://doi.org/10.7302/s3nc-wh40",
    "license":
      {"@type": "CreativeWork",
       "name": "Attribution 4.0 International (CC BY 4.0)",
       "license": "http://creativecommons.org/licenses/by/4.0/"},
    "publisher":
      {"@id": "https://deepblue.lib.umich.edu/data/",
       "@type": "Organization",
       "legalName": "University of Michigan - Deep Blue Data",
       "name": "Deep Blue Data",
       "url": "https://deepblue.lib.umich.edu/data"}
}

Required Properties

name

A descriptive name of the dataset. For example, “Snow depth in the Northern Hemisphere”.

The name property is modeled as Text.

description

A short summary describing the dataset.

The summary must be between 50 and 5000 characters long and may include Markdown syntax. Embedded images need to use absolute path URLs.

The description property is modeled as Text.

distribution.contentUrl

The link for the download.

The distribution.contentUrl is modeled as a URL.

Recommended Properties

alternateName

Alternative names that have been used to refer to this dataset, such as aliases or abbreviations.

The property is modeled as Text.

creator

The creator or author of this dataset.

If the creator is a person, it should be modelled as a Person. If it is an organization, it should be modelled as a Organization.

To uniquely identify individuals, use ORCID ID as the value of the sameAs property of the Person type.

To uniquely identify institutions and organizations, use ROR ID (UT Example).

citation

Identifies academic articles that are recommended by the data provider be cited in addition to the dataset itself.

Provide the citation for the dataset itself with other properties, such as name, identifier, creator, and publisher properties. For example, this property can uniquely identify a related academic publication such as a data descriptor, data paper, or an article for which this dataset is supplementary material for.

Don’t use this property to provide citation information for the dataset itself. It is intended to identify related academic articles, not the dataset itself. To provide information necessary to cite the dataset itself use name, identifier, creator, and publisher properties instead.

The property is modeled as Text or CreativeWork.

distribution

The description of the location for download of the dataset and the file format for download.

The property is modelled as DataDownload.

distribution.encodingFormat

The file format of the distribution.

The property is modeled as Text or URL.

funder

A person or organization that provided financial support for this dataset.

To uniquely identify individuals, use ORCID ID as the value of the sameAs property of the Person type.

To uniquely identify institutions and organizations, use ROR ID.

If the funder is a person, it should be modelled as a Person. If it is an organization, it should be modelled as a Organization.

hasPart or isPartOf

If the dataset is a collection of smaller datasets, use the hasPart property to denote such relationship.

Conversly, if the dataset is part of a larger dataset, use isPartOf. Both properties can take the form of a URL or a Dataset instance. In case Dataset is used as a value it has to include all of the properties required for a standalone Dataset.

The property is modeled as URL or Dataset.

identifier

An identifier, such as a DOI or a Compact Identifier. When JSON-LD, this is represented using JSON list syntax.

The property is modeled as URL, Text, or PropertyValue.

includedInDataCatalog

The catalog to which the dataset belongs.

The full definition of DataCatalog is available at schema.org/DataCatalog.

Datasets are often published in repositories that contain many other datasets. The same dataset can be included in more than one such repository. You can refer to a data catalog that this dataset belongs to by referencing it directly.

The property is modelled as DataCatalog.

isAccessibleForFree

Is the dataset is accessible without payment.

The property is modeled as Boolean.

keywords

Keywords summarizing the dataset.

The property is modelled as Text.

license

A license under which the dataset is distributed.

The property can be modelled as Text or Creative Work.

measurementTechnique

Note: This property is pending standardization.

The technique, technology, or methodology used in a dataset, which can correspond to the variable(s) described in variableMeasured.

The property can be modelled as Text or URL.

sameAs

The URL of a reference web page that unambiguously indicates the dataset’s identity.

The property is modelled as URL.

spatialCoverage

A single point that describes the spatial aspect of the dataset. Only include this property if the dataset has a spatial dimension. For example, a single point where all the measurements were collected, or the coordinates of a bounding box for an area.

This property is modelled as Text or Place.

temporalCoverage

If the data in the dataset covers a specific time interval, it can be modelled here.

Only include this property if the dataset has a temporal dimension. Use ISO 8601 standard to describe time intervals and time points. You can describe dates differently depending upon the dataset interval. Indicate open-ended intervals with two decimal points (..).

The property is modelled as Text.

Examples:

Single Date

"temporalCoverage" : "2008"

Time Period

"temporalCoverage" : "1950-01-01/2013-12-18"

Open-ended Time Period

"temporalCoverage" : "2013-12-19/.."

variableMeasured

Note: This property is pending standardization.

The variable that this dataset measures. For example, temperature or pressure.

The property can be modelled as Text or PropertyValue.

version

The version number for the dataset.

The property can be modelled as Text or Number.

url

Location of a page describing the dataset.

The property can be modelled as URL.