datalad.tests.utils

Miscellaneous utilities to assist with testing

class datalad.tests.utils.HTTPPath(path)

Bases: object

Serve the content of a path via an HTTP URL.

This class can be used as a context manager, in which case it returns the URL.

Alternatively, the start and stop methods can be called directly.

Parameters:path (str) – Directory with content to serve.

start()

Start serving path via HTTP.

stop()

Stop serving path.

class datalad.tests.utils.SilentHTTPHandler(*args, **kwargs)

Bases: http.server.SimpleHTTPRequestHandler

A little adapter to silence the handler

log_message(format, *args)

Log an arbitrary message.

This is used by all other logging functions. Override it if you have specific logging wishes.

The first argument, FORMAT, is a format string for the message to be logged. If the format string contains any % escapes requiring parameters, they should be specified as subsequent arguments (it’s just like printf!).

The client ip and current date/time are prefixed to every message.

datalad.tests.utils.assert_dict_equal(d1, d2)

datalad.tests.utils.assert_in_results(results, **kwargs)

Verify that the particular combination of keys and values is found in one of the results

datalad.tests.utils.assert_is_generator(gen)

datalad.tests.utils.assert_message(message, results)

Verify that each status dict in the results has a message

This only tests the message template string, and not a formatted message with args expanded.

datalad.tests.utils.assert_no_errors_logged(func, skip_re=None)

Decorator around function to assert that no errors logged during its execution

datalad.tests.utils.assert_not_in_results(results, **kwargs)

Verify that the particular combination of keys and values is not in any of the results

datalad.tests.utils.assert_re_in(regex, c, flags=0, match=True, msg=None)

Assert that container (list, str, etc) contains entry matching the regex

datalad.tests.utils.assert_repo_status(path, annex=None, untracked_mode='normal', **kwargs)

Compare a repo status against (optional) exceptions.

Anything file/directory that is not explicitly indicated must have state ‘clean’, i.e. no modifications and recorded in Git.

Parameters:

• path (str or Repo) – in case of a str: path to the repository’s base dir; Note, that passing a Repo instance prevents detecting annex. This might be useful in case of a non-initialized annex, a GitRepo is pointing to.
• annex (bool or None) – explicitly set to True or False to indicate, that an annex is (not) expected; set to None to autodetect, whether there is an annex. Default: None.
• untracked_mode ({'no', 'normal', 'all'}) – If and how untracked content is reported. The specification of untracked files that are OK to be found must match this mode. See Repo.status()
• **kwargs – Files/directories that are OK to not be in ‘clean’ state. Each argument must be one of ‘added’, ‘untracked’, ‘deleted’, ‘modified’ and each value must be a list of filenames (relative to the root of the repository, in POSIX convention).

datalad.tests.utils.assert_result_count(results, n, **kwargs)

Verify specific number of results (matching criteria, if any)

datalad.tests.utils.assert_result_values_cond(results, prop, cond)

Verify that the values of all results for a given key in the status dicts fullfill condition cond.

Parameters:

• results –
• prop (str) –
• cond (callable) –

datalad.tests.utils.assert_result_values_equal(results, prop, values)

Verify that the values of all results for a given key in the status dicts match the given sequence

datalad.tests.utils.assert_status(label, results)

Verify that each status dict in the results has a given status label

label can be a sequence, in which case status must be one of the items in this sequence.

datalad.tests.utils.assert_str_equal(s1, s2)

Helper to compare two lines

datalad.tests.utils.check_not_generatorfunction(func)

Internal helper to verify that we are not decorating generator tests

datalad.tests.utils.clone_url(url)

datalad.tests.utils.get_convoluted_situation(path, repocls=<class 'datalad.support.annexrepo.AnnexRepo'>)

datalad.tests.utils.get_datasets_topdir()

Delayed parsing so it could be monkey patched etc

datalad.tests.utils.get_deeply_nested_structure(path)

Here is what this does (assuming UNIX, locked): | . | ├── directory_untracked | │   └── link2dir -> ../subdir | ├── OBSCURE_FILENAME_file_modified | ├── link2dir -> subdir | ├── link2subdsdir -> subds_modified/subdir | ├── link2subdsroot -> subds_modified | ├── subdir | │   ├── annexed_file.txt -> ../.git/annex/objects/… | │   ├── file_modified | │   ├── git_file.txt | │   └── link2annex_files.txt -> annexed_file.txt | └── subds_modified | ├── link2superdsdir -> ../subdir | ├── subdir | │   └── annexed_file.txt -> ../.git/annex/objects/… | └── subds_lvl1_modified | └── OBSCURE_FILENAME_directory_untracked | └── untracked_file

When a system has no symlink support, the link2… components are not included.

datalad.tests.utils.get_most_obscure_supported_name(tdir, return_candidates=False)

Return the most obscure filename that the filesystem would support under TEMPDIR

Parameters:

• return_candidates (bool, optional) – if True, return a tuple of (good, candidates) where candidates are “partially” sorted from trickiest considered
• TODO (we might want to use it as a function where we would provide tdir) –

datalad.tests.utils.get_mtimes_and_digests(target_path)

Return digests (md5) and mtimes for all the files under target_path

datalad.tests.utils.get_ssh_port(host)

Get port of host in ssh_config.

Our tests depend on the host being defined in ssh_config, including its port. This method can be used by tests that want to check handling of an explicitly specified

Note that if host does not match a host in ssh_config, the default value of 22 is returned.

Parameters:host (str) – Returns: Return type:port (int) Raises:SkipTest if port cannot be found.

datalad.tests.utils.has_symlink_capability(p1, p2)

datalad.tests.utils.ignore_nose_capturing_stdout(func)

DEPRECATED and will be removed soon. Does nothing!

Originally was intended as a decorator workaround for nose’s behaviour with redirecting sys.stdout, but now we monkey patch nose now so no test should no longer be skipped.

See issue reported here: https://code.google.com/p/python-nose/issues/detail?id=243&can=1&sort=-id&colspec=ID%20Type%20Status%20Priority%20Stars%20Milestone%20Owner%20Summary

datalad.tests.utils.integration(f)

Mark test as an “integration” test which generally is not needed to be run

Generally tend to be slower. Should be used in combination with @slow and @turtle if that is the case.

datalad.tests.utils.known_failure(func)

Test decorator marking a test as known to fail

This combines probe_known_failure and skip_known_failure giving the skipping precedence over the probing.

datalad.tests.utils.known_failure_appveyor(func)

Test decorator marking a test as known to fail on AppVeyor.

datalad.tests.utils.known_failure_direct_mode(func)

DEPRECATED. Stop using. Does nothing

Test decorator marking a test as known to fail in a direct mode test run

If datalad.repo.direct is set to True behaves like known_failure. Otherwise the original (undecorated) function is returned.

datalad.tests.utils.known_failure_githubci_osx(func)

Test decorator for a known test failure on Github’s macOS CI

datalad.tests.utils.known_failure_githubci_win(func)

Test decorator for a known test failure on Github’s Windows CI

datalad.tests.utils.known_failure_v6(func)

Test decorator marking a test as known to fail in a v6+ test run

If the default repository version is 6 or later behaves like known_failure. Otherwise the original (undecorated) function is returned. The default repository version is controlled by the configured value of DATALAD_REPO_VERSION and whether v5 repositories are supported by the installed git-annex.

datalad.tests.utils.known_failure_v6_or_later(func)

Test decorator marking a test as known to fail in a v6+ test run

If the default repository version is 6 or later behaves like known_failure. Otherwise the original (undecorated) function is returned. The default repository version is controlled by the configured value of DATALAD_REPO_VERSION and whether v5 repositories are supported by the installed git-annex.

datalad.tests.utils.known_failure_windows(func)

Test decorator marking a test as known to fail on windows

On Windows behaves like known_failure. Otherwise the original (undecorated) function is returned.

datalad.tests.utils.nok_startswith(s, prefix)

datalad.tests.utils.ok_annex_get(ar, files, network=True)

Helper to run .get decorated checking for correct operation

get passes through stderr from the ar to the user, which pollutes screen while running tests

Note: Currently not true anymore, since usage of –json disables progressbars

datalad.tests.utils.ok_archives_caches(repopath, n=1, persistent=None)

Given a path to repository verify number of archives

Parameters:

• repopath (str) – Path to the repository
• n (int, optional) – Number of archives directories to expect
• persistent (bool or None, optional) – If None – both persistent and not count.

datalad.tests.utils.ok_broken_symlink(path)

datalad.tests.utils.ok_clean_git(path, annex=None, index_modified=[], untracked=[])

Obsolete test helper. Use assert_repo_status() instead.

Still maps a few common cases to the new helper, to ease transition in extensions.

datalad.tests.utils.ok_endswith(s, suffix)

datalad.tests.utils.ok_exists(path)

datalad.tests.utils.ok_file_has_content(path, content, strip=False, re_=False, decompress=False, **kwargs)

Verify that file exists and has expected content

datalad.tests.utils.ok_file_under_git(path, filename=None, annexed=False)

Test if file is present and under git/annex control

If relative path provided, then test from current directory

datalad.tests.utils.ok_generator(gen)

datalad.tests.utils.ok_git_config_not_empty(ar)

Helper to verify that nothing rewritten the config file

datalad.tests.utils.ok_good_symlink(path)

datalad.tests.utils.ok_startswith(s, prefix)

datalad.tests.utils.ok_symlink(path)

Checks whether path is either a working or broken symlink

datalad.tests.utils.patch_config(vars)

Patch our config with custom settings. Returns mock.patch cm

datalad.tests.utils.probe_known_failure(func)

Test decorator allowing the test to pass when it fails and vice versa

Setting config datalad.tests.knownfailures.probe to True tests, whether or not the test is still failing. If it’s not, an AssertionError is raised in order to indicate that the reason for failure seems to be gone.

datalad.tests.utils.put_file_under_git(path, filename=None, content=None, annexed=False)

Place file under git/annex and return used Repo

datalad.tests.utils.set_annex_version(version)

Override the git-annex version.

This temporarily masks the git-annex version present in external_versions and make AnnexRepo forget its cached version information.

datalad.tests.utils.set_date(timestamp)

Temporarily override environment variables for git/git-annex dates.

Parameters:timestamp (int) – Unix timestamp.

datalad.tests.utils.skip_httpretty_on_problematic_pythons(func)

As discovered some httpretty bug causes a side-effect on other tests on some Pythons. So we skip the test if such problematic combination detected

References https://travis-ci.org/datalad/datalad/jobs/94464988 http://stackoverflow.com/a/29603206/1265472

datalad.tests.utils.skip_if_no_module(module)

datalad.tests.utils.skip_if_no_network(func=None)

Skip test completely in NONETWORK settings

If not used as a decorator, and just a function, could be used at the module level

datalad.tests.utils.skip_if_on_windows(func=None)

Skip test completely under Windows

datalad.tests.utils.skip_if_root(func=None)

Skip test if uid == 0.

Note that on Windows (or anywhere else os.geteuid is not available) the test is _not_ skipped.

datalad.tests.utils.skip_if_scrapy_without_selector()

A little helper to skip some tests which require recent scrapy

datalad.tests.utils.skip_if_url_is_not_available(url, regex=None)

datalad.tests.utils.skip_nomultiplex_ssh(func)

Skips SSH tests if default connection/manager does not support multiplexing

e.g. currently on windows or if set via datalad.ssh.multiplex-connections config variable

datalad.tests.utils.skip_ssh(func)

Skips SSH tests if on windows or if environment variable DATALAD_TESTS_SSH was not set

datalad.tests.utils.skip_wo_symlink_capability(func)

Skip test when environment does not support symlinks

Perform a behavioral test instead of top-down logic, as on windows this could be on or off on a case-by-case basis.

datalad.tests.utils.slow(f)

Mark test as a slow, although not necessarily integration or usecase test

Rule of thumb cut-off to mark as slow is 10 sec

datalad.tests.utils.turtle(f)

Mark test as very slow, meaning to not run it on Travis due to its time limit

Rule of thumb cut-off to mark as turtle is 2 minutes

datalad.tests.utils.usecase(f)

Mark test as a usecase user ran into and which (typically) caused bug report to be filed/troubleshooted

Should be used in combination with @slow and @turtle if slow.