datalad.api.Dataset

class datalad.api.Dataset(path)

Representation of a DataLad dataset/repository

This is the core data type of DataLad: a representation of a dataset. At its core, datasets are (git-annex enabled) Git repositories. This class provides all operations that can be performed on a dataset.

Creating a dataset instance is cheap, all actual operations are delayed until they are actually needed. Creating multiple Dataset class instances for the same Dataset location will automatically yield references to the same object.

A dataset instance comprises of two major components: a repo attribute, and a config attribute. The former offers access to low-level functionality of the Git or git-annex repository. The latter gives access to a dataset’s configuration manager.

Most functionality is available via methods of this class, but also as stand-alone functions with the same name in datalad.api.

__init__(path)

Parameters:path (str or Path) – Path to the dataset location. This location may or may not exist yet.

Methods

__init__(path)	param path:Path to the dataset location. This location may or may not exist
add_readme([filename, existing])	Add basic information about DataLad datasets to a README file
addurls(urlfile, urlformat, filenameformat)	Create and update a dataset from a list of URLs.
aggregate_metadata([dataset, recursive, …])	Aggregate metadata of one or more datasets for later query.
annotate_paths([dataset, recursive, …])	Analyze and act upon input paths
clean([what, recursive, recursion_limit])	Clean up after DataLad (possible temporary files etc.)
clone([path, dataset, description, reckless])	Obtain a dataset (copy) from a URL or local directory
close()	Perform operations which would close any possible process using this Dataset
copy_file([dataset, recursive, target_dir, …])	Copy files and their availability metadata from one dataset to another.
create([initopts, force, description, …])	Create a new dataset from scratch.
create_sibling([name, target_dir, …])	Create a dataset sibling on a UNIX-like Shell (local or SSH)-accessible machine
create_sibling_github([dataset, recursive, …])	Create dataset sibling on GitHub.
create_sibling_gitlab([site, project, …])	Create dataset sibling at a GitLab site
create_sibling_ria(name[, dataset, …])	Creates a sibling to a dataset in a RIA store
diff([fr, to, dataset, annex, untracked, …])	Report differences between two states of a dataset (hierarchy)
download_url([dataset, path, overwrite, …])	Download content
drop([dataset, recursive, recursion_limit, …])	Drop file content from datasets
export_archive([filename, archivetype, …])	Export the content of a dataset as a TAR/ZIP archive.
export_archive_ora([opts, dataset])	Export an archive of a local annex object store for the ORA remote.
export_to_figshare([filename, …])	Export the content of a dataset as a ZIP archive to figshare
extract_metadata([files, dataset])	Run one or more of DataLad’s metadata extractors on a dataset or file.
get([source, dataset, recursive, …])	Get any dataset content (files/directories/subdatasets).
get_superdataset([datalad_only, topmost, …])	Get the dataset’s superdataset
install([source, dataset, get_data, …])	Install a dataset from a (remote) source.
is_installed()	Returns whether a dataset is installed.
metadata([dataset, get_aggregates, …])	Metadata reporting for files and entire datasets
no_annex(pattern[, ref_dir, makedirs])	Configure a dataset to never put some content into the dataset’s annex
publish([dataset, to, since, missing, …])	Publish a dataset to a known sibling.
push([dataset, to, since, data, force, …])	Push a dataset to a known sibling.
recall_state(whereto)	Something that can be used to checkout a particular state (tag, commit) to “undo” a change or switch to a otherwise desired previous state.
remove([dataset, recursive, check, save, …])	Remove components from datasets
rerun([since, dataset, branch, message, …])	Re-execute previous datalad run commands.
run([dataset, inputs, outputs, expand, …])	Run an arbitrary shell command and record its impact on a dataset.
run_procedure([dataset, discover, help_proc])	Run prepared procedures (DataLad scripts) on a dataset
save([message, dataset, version_tag, …])	Save the current state of a dataset
search([dataset, force_reindex, …])	Search dataset metadata
siblings([dataset, name, url, pushurl, …])	Manage sibling configuration
status([dataset, annex, untracked, …])	Report on the state of dataset content.
subdatasets([dataset, fulfilled, recursive, …])	Report subdatasets and their properties.
uninstall([dataset, recursive, check, if_dirty])	Uninstall subdatasets
unlock([dataset, recursive, recursion_limit])	Unlock file(s) of a dataset
update([sibling, merge, follow, dataset, …])	Update a dataset from a sibling.
wtf([sensitive, sections, flavor, decor, …])	Generate a report about the DataLad installation and configuration

Attributes

config	Get an instance of the parser for the persistent dataset configuration.
id	Identifier of the dataset.
path	path to the dataset
pathobj	pathobj for the dataset
repo	Get an instance of the version control system/repo for this dataset, or None if there is none yet (or none anymore).