datalad-crawl¶
Synopsis¶
datalad-crawl [-h] [--is-pipeline] [-t] [-r] [-C CHDIR] [file]
Description¶
Crawl online resource to create or update a dataset.
Examples:
$ datalad crawl # within a dataset having .datalad/crawl/crawl.cfg
Options¶
file¶
configuration (or pipeline if –is-pipeline) file defining crawling, or a directory of a dataset on which to perform crawling using its standard crawling specification. Constraints: value must be a string [Default: None]
-h, –help, –help-np¶
show this help message. –help-np forcefully disables the use of a pager for displaying the help message
–is-pipeline¶
flag if provided file is a Python script which defines pipeline(). [Default: False]
-t, –is-template¶
flag if provided value is the name of the template to use. [Default: False]
-r, –recursive¶
flag to crawl subdatasets as well (for now serially). [Default: False]
-C CHDIR, –chdir CHDIR¶
directory to chdir to for crawling. Constraints: value must be a string [Default: None]
Authors¶
datalad is developed by The DataLad Team and Contributors <team@datalad.org>.