datalad.api.Dataset¶
-
class
datalad.api.
Dataset
(path)[source]¶ Representation of a DataLad dataset/repository
This is the core data type of DataLad: a representation of a dataset. At its core, datasets are (git-annex enabled) Git repositories. This class provides all operations that can be performed on a dataset.
Creating a dataset instance is cheap, all actual operations are delayed until they are actually needed. Creating multiple Dataset class instances for the same Dataset location will automatically yield references to the same object.
A dataset instance comprises of two major components: a repo attribute, and a config attribute. The former offers access to low-level functionality of the Git or git-annex repository. The latter gives access to a dataset’s configuration manager.
Most functionality is available via methods of this class, but also as stand-alone functions with the same name in datalad.api.
-
__init__
(path)[source]¶ Parameters: path (str or Path) – Path to the dataset location. This location may or may not exist yet.
Methods
__init__
(path)param path: Path to the dataset location. This location may or may not exist add_readme
([filename, existing])Add basic information about DataLad datasets to a README file addurls
(urlfile, urlformat, filenameformat)Create and update a dataset from a list of URLs. aggregate_metadata
([dataset, recursive, …])Aggregate metadata of one or more datasets for later query. annotate_paths
([dataset, recursive, …])Analyze and act upon input paths clean
([what, recursive, recursion_limit])Clean up after DataLad (possible temporary files etc.) clone
([path, dataset, description, reckless])Obtain a dataset (copy) from a URL or local directory close
()Perform operations which would close any possible process using this Dataset copy_file
([dataset, recursive, target_dir, …])Copy files and their availability metadata from one dataset to another. create
([initopts, force, description, …])Create a new dataset from scratch. create_sibling
([name, target_dir, …])Create a dataset sibling on a UNIX-like Shell (local or SSH)-accessible machine create_sibling_github
([dataset, recursive, …])Create dataset sibling on GitHub. create_sibling_gitlab
([site, project, …])Create dataset sibling at a GitLab site create_sibling_ria
(name[, dataset, …])Creates a sibling to a dataset in a RIA store diff
([fr, to, dataset, annex, untracked, …])Report differences between two states of a dataset (hierarchy) download_url
([dataset, path, overwrite, …])Download content drop
([dataset, recursive, recursion_limit, …])Drop file content from datasets export_archive
([filename, archivetype, …])Export the content of a dataset as a TAR/ZIP archive. export_archive_ora
([opts, dataset])Export an archive of a local annex object store for the ORA remote. export_to_figshare
([filename, …])Export the content of a dataset as a ZIP archive to figshare extract_metadata
([files, dataset])Run one or more of DataLad’s metadata extractors on a dataset or file. get
([source, dataset, recursive, …])Get any dataset content (files/directories/subdatasets). get_superdataset
([datalad_only, topmost, …])Get the dataset’s superdataset install
([source, dataset, get_data, …])Install a dataset from a (remote) source. is_installed
()Returns whether a dataset is installed. metadata
([dataset, get_aggregates, …])Metadata reporting for files and entire datasets no_annex
(pattern[, ref_dir, makedirs])Configure a dataset to never put some content into the dataset’s annex publish
([dataset, to, since, missing, …])Publish a dataset to a known sibling. push
([dataset, to, since, data, force, …])Push a dataset to a known sibling. recall_state
(whereto)Something that can be used to checkout a particular state (tag, commit) to “undo” a change or switch to a otherwise desired previous state. remove
([dataset, recursive, check, save, …])Remove components from datasets rerun
([since, dataset, branch, message, …])Re-execute previous datalad run commands. run
([dataset, inputs, outputs, expand, …])Run an arbitrary shell command and record its impact on a dataset. run_procedure
([dataset, discover, help_proc])Run prepared procedures (DataLad scripts) on a dataset save
([message, dataset, version_tag, …])Save the current state of a dataset search
([dataset, force_reindex, …])Search dataset metadata siblings
([dataset, name, url, pushurl, …])Manage sibling configuration status
([dataset, annex, untracked, …])Report on the state of dataset content. subdatasets
([dataset, fulfilled, recursive, …])Report subdatasets and their properties. uninstall
([dataset, recursive, check, if_dirty])Uninstall subdatasets unlock
([dataset, recursive, recursion_limit])Unlock file(s) of a dataset update
([sibling, merge, follow, dataset, …])Update a dataset from a sibling. wtf
([sensitive, sections, decor, clipboard])Generate a report about the DataLad installation and configuration Attributes
config
Get an instance of the parser for the persistent dataset configuration. id
Identifier of the dataset. path
path to the dataset pathobj
pathobj for the dataset repo
Get an instance of the version control system/repo for this dataset, or None if there is none yet (or none anymore). -