datalad_crawler.crawl

Interface for crawling a webpage and push extracted data into a dataset

class datalad_crawler.crawl.Crawl

Bases: datalad.interface.base.Interface

Crawl online resource to create or update a dataset.

Examples

$ datalad crawl # within a dataset having .datalad/crawl/crawl.cfg