Failure of ErrorclassesΒΆ

Errorclasses (skips, deprecations, etc.) define whether or not they represent test failures.

>>> import os
>>> import sys
>>> from nose.plugins.plugintest import run_buffered as run
>>> from nose.plugins.skip import Skip
>>> from nose.plugins.deprecated import Deprecated
>>> support = os.path.join(os.path.dirname(__file__), 'support')
>>> sys.path.insert(0, support)
>>> from errorclass_failure_plugin import Todo, TodoPlugin, \
...                                       NonFailureTodoPlugin
>>> todo_test = os.path.join(support, 'errorclass_failing_test.py')
>>> misc_test = os.path.join(support, 'errorclass_tests.py')

nose.plugins.errorclass.ErrorClass has an argument isfailure. With a true isfailure, when the errorclass’ exception is raised by a test, tracebacks are printed.

>>> run(argv=["nosetests", "-v", "--with-todo", todo_test],
...     plugins=[TodoPlugin()])  
errorclass_failing_test.test_todo ... TODO: fix me
errorclass_failing_test.test_2 ... ok

======================================================================
TODO: errorclass_failing_test.test_todo
----------------------------------------------------------------------
Traceback (most recent call last):
...
Todo: fix me

----------------------------------------------------------------------
Ran 2 tests in ...s

FAILED (TODO=1)

Also, --stop stops the test run.

>>> run(argv=["nosetests", "-v", "--with-todo", "--stop", todo_test],
...     plugins=[TodoPlugin()])  
errorclass_failing_test.test_todo ... TODO: fix me

======================================================================
TODO: errorclass_failing_test.test_todo
----------------------------------------------------------------------
Traceback (most recent call last):
...
Todo: fix me

----------------------------------------------------------------------
Ran 1 test in ...s

FAILED (TODO=1)

With a false .isfailure, errorclass exceptions raised by tests are treated as “ignored errors.” For ignored errors, tracebacks are not printed, and the test run does not stop.

>>> run(argv=["nosetests", "-v", "--with-non-failure-todo", "--stop",
...           todo_test],
...     plugins=[NonFailureTodoPlugin()])  
errorclass_failing_test.test_todo ... TODO: fix me
errorclass_failing_test.test_2 ... ok

----------------------------------------------------------------------
Ran 2 tests in ...s

OK (TODO=1)

Exception detail strings of errorclass errors are always printed when -v is in effect, regardless of whether the error is ignored. Note that exception detail strings may have more than one line.

>>> run(argv=["nosetests", "-v", "--with-todo", misc_test],
...     plugins=[TodoPlugin(), Skip(), Deprecated()])
... 
errorclass_tests.test_todo ... TODO: fix me
errorclass_tests.test_2 ... ok
errorclass_tests.test_3 ... SKIP: skipety-skip
errorclass_tests.test_4 ... SKIP
errorclass_tests.test_5 ... DEPRECATED: spam
eggs

spam
errorclass_tests.test_6 ... DEPRECATED: spam

======================================================================
TODO: errorclass_tests.test_todo
----------------------------------------------------------------------
Traceback (most recent call last):
...
Todo: fix me

----------------------------------------------------------------------
Ran 6 tests in ...s

FAILED (DEPRECATED=2, SKIP=2, TODO=1)

Without -v, the exception detail strings are only displayed if the error is not ignored (otherwise, there’s no traceback).

>>> run(argv=["nosetests", "--with-todo", misc_test],
...     plugins=[TodoPlugin(), Skip(), Deprecated()])
... 
T.SSDD
======================================================================
TODO: errorclass_tests.test_todo
----------------------------------------------------------------------
Traceback (most recent call last):
...
Todo: fix me

----------------------------------------------------------------------
Ran 6 tests in ...s

FAILED (DEPRECATED=2, SKIP=2, TODO=1)
>>> sys.path.remove(support)