2018-02-08 06:53:31 +08:00
|
|
|
|
|
|
|
|
|
Reference
|
|
|
|
|
=========
|
|
|
|
|
|
|
|
|
|
This page contains the full reference to pytest's API.
|
|
|
|
|
|
2018-02-27 07:13:33 +08:00
|
|
|
|
.. contents::
|
2018-02-28 04:32:34 +08:00
|
|
|
|
:depth: 3
|
2018-02-27 07:27:15 +08:00
|
|
|
|
:local:
|
|
|
|
|
|
2018-03-02 05:07:06 +08:00
|
|
|
|
Functions
|
|
|
|
|
---------
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-02-28 05:26:40 +08:00
|
|
|
|
pytest.approx
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.python_api.approx
|
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.fail
|
|
|
|
|
~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-03-02 05:07:06 +08:00
|
|
|
|
**Tutorial**: :ref:`skipping`
|
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.outcomes.fail
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.skip
|
|
|
|
|
~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
.. autofunction:: _pytest.outcomes.skip(msg, [allow_module_level=False])
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.importorskip
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.outcomes.importorskip
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.xfail
|
|
|
|
|
~~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.outcomes.xfail
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.exit
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.outcomes.exit
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.main
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-27 07:27:15 +08:00
|
|
|
|
.. autofunction:: _pytest.config.main
|
|
|
|
|
|
2018-03-01 07:34:20 +08:00
|
|
|
|
pytest.param
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~~
|
2018-03-01 07:34:20 +08:00
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
.. autofunction:: pytest.param(*values, [id], [marks])
|
2018-03-01 07:34:20 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.raises
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~~
|
2018-02-27 07:57:02 +08:00
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :ref:`assertraises`.
|
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
.. autofunction:: pytest.raises(expected_exception: Exception, [match], [message])
|
2018-02-27 07:57:02 +08:00
|
|
|
|
:with: excinfo
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-02-28 04:15:08 +08:00
|
|
|
|
pytest.deprecated_call
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~
|
2018-02-27 07:34:53 +08:00
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :ref:`ensuring_function_triggers`.
|
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
.. autofunction:: pytest.deprecated_call()
|
2018-02-27 07:57:02 +08:00
|
|
|
|
:with:
|
2018-02-08 06:53:31 +08:00
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
pytest.register_assert_rewrite
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
2018-03-02 04:54:54 +08:00
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`assertion-rewriting`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: pytest.register_assert_rewrite
|
|
|
|
|
|
2018-02-28 05:26:40 +08:00
|
|
|
|
pytest.warns
|
2018-03-02 05:07:06 +08:00
|
|
|
|
~~~~~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`assertwarnings`
|
|
|
|
|
|
2018-03-02 04:54:54 +08:00
|
|
|
|
.. autofunction:: pytest.warns(expected_warning: Exception, [match])
|
2018-02-28 05:26:40 +08:00
|
|
|
|
:with:
|
|
|
|
|
|
2018-10-02 22:39:08 +08:00
|
|
|
|
pytest.freeze_includes
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`freezing-pytest`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: pytest.freeze_includes
|
2018-03-02 05:20:55 +08:00
|
|
|
|
|
|
|
|
|
.. _`marks ref`:
|
|
|
|
|
|
2018-03-01 07:34:20 +08:00
|
|
|
|
Marks
|
|
|
|
|
-----
|
|
|
|
|
|
|
|
|
|
Marks can be used apply meta data to *test functions* (but not fixtures), which can then be accessed by
|
|
|
|
|
fixtures or plugins.
|
|
|
|
|
|
|
|
|
|
|
2018-04-06 00:39:57 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-23 00:02:30 +08:00
|
|
|
|
.. _`pytest.mark.filterwarnings ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.filterwarnings
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`filterwarnings`.
|
|
|
|
|
|
|
|
|
|
Add warning filters to marked test items.
|
|
|
|
|
|
|
|
|
|
.. py:function:: pytest.mark.filterwarnings(filter)
|
|
|
|
|
|
|
|
|
|
:keyword str filter:
|
|
|
|
|
A *warning specification string*, which is composed of contents of the tuple ``(action, message, category, module, lineno)``
|
|
|
|
|
as specified in `The Warnings filter <https://docs.python.org/3/library/warnings.html#warning-filter>`_ section of
|
|
|
|
|
the Python documentation, separated by ``":"``. Optional fields can be omitted.
|
2018-10-28 13:12:12 +08:00
|
|
|
|
Module names passed for filtering are not regex-escaped.
|
2018-03-23 00:02:30 +08:00
|
|
|
|
|
|
|
|
|
For example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
@pytest.mark.warnings("ignore:.*usage will be deprecated.*:DeprecationWarning")
|
|
|
|
|
def test_foo():
|
|
|
|
|
...
|
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:34:20 +08:00
|
|
|
|
.. _`pytest.mark.parametrize ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.parametrize
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`parametrize`.
|
|
|
|
|
|
|
|
|
|
.. automethod:: _pytest.python.Metafunc.parametrize
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. _`pytest.mark.skip ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.skip
|
|
|
|
|
~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`skip`.
|
|
|
|
|
|
|
|
|
|
Unconditionally skip a test function.
|
|
|
|
|
|
|
|
|
|
.. py:function:: pytest.mark.skip(*, reason=None)
|
|
|
|
|
|
|
|
|
|
:keyword str reason: Reason why the test function is being skipped.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. _`pytest.mark.skipif ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.skipif
|
|
|
|
|
~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
2018-05-17 21:15:47 +08:00
|
|
|
|
**Tutorial**: :ref:`skipif`.
|
2018-03-01 07:34:20 +08:00
|
|
|
|
|
|
|
|
|
Skip a test function if a condition is ``True``.
|
|
|
|
|
|
|
|
|
|
.. py:function:: pytest.mark.skipif(condition, *, reason=None)
|
|
|
|
|
|
|
|
|
|
:type condition: bool or str
|
|
|
|
|
:param condition: ``True/False`` if the condition should be skipped or a :ref:`condition string <string conditions>`.
|
|
|
|
|
:keyword str reason: Reason why the test function is being skipped.
|
|
|
|
|
|
|
|
|
|
|
2018-07-07 07:55:42 +08:00
|
|
|
|
.. _`pytest.mark.usefixtures ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.usefixtures
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`usefixtures`.
|
|
|
|
|
|
|
|
|
|
Mark a test function as using the given fixture names.
|
|
|
|
|
|
2018-07-07 21:01:10 +08:00
|
|
|
|
.. warning::
|
|
|
|
|
|
2018-10-12 20:43:00 +08:00
|
|
|
|
This mark has no effect when applied
|
2018-07-07 21:01:10 +08:00
|
|
|
|
to a **fixture** function.
|
|
|
|
|
|
2018-07-07 07:55:42 +08:00
|
|
|
|
.. py:function:: pytest.mark.usefixtures(*names)
|
|
|
|
|
|
2018-07-07 21:01:10 +08:00
|
|
|
|
:param args: the names of the fixture to use, as strings
|
2018-07-07 07:55:42 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:34:20 +08:00
|
|
|
|
.. _`pytest.mark.xfail ref`:
|
|
|
|
|
|
|
|
|
|
pytest.mark.xfail
|
|
|
|
|
~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`xfail`.
|
|
|
|
|
|
|
|
|
|
Marks a test function as *expected to fail*.
|
|
|
|
|
|
|
|
|
|
.. py:function:: pytest.mark.xfail(condition=None, *, reason=None, raises=None, run=True, strict=False)
|
|
|
|
|
|
|
|
|
|
:type condition: bool or str
|
|
|
|
|
:param condition: ``True/False`` if the condition should be marked as xfail or a :ref:`condition string <string conditions>`.
|
|
|
|
|
:keyword str reason: Reason why the test function is marked as xfail.
|
|
|
|
|
:keyword Exception raises: Exception subclass expected to be raised by the test function; other exceptions will fail the test.
|
|
|
|
|
:keyword bool run:
|
|
|
|
|
If the test function should actually be executed. If ``False``, the function will always xfail and will
|
|
|
|
|
not be executed (useful a function is segfaulting).
|
|
|
|
|
:keyword bool strict:
|
|
|
|
|
* If ``False`` (the default) the function will be shown in the terminal output as ``xfailed`` if it fails
|
|
|
|
|
and as ``xpass`` if it passes. In both cases this will not cause the test suite to fail as a whole. This
|
|
|
|
|
is particularly useful to mark *flaky* tests (tests that random at fail) to be tackled later.
|
|
|
|
|
* If ``True``, the function will be shown in the terminal output as ``xfailed`` if it fails, but if it
|
|
|
|
|
unexpectedly passes then it will **fail** the test suite. This is particularly useful to mark functions
|
|
|
|
|
that are always failing and there should be a clear indication if they unexpectedly start to pass (for example
|
|
|
|
|
a new release of a library fixes a known bug).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
custom marks
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
Marks are created dynamically using the factory object ``pytest.mark`` and applied as a decorator.
|
|
|
|
|
|
|
|
|
|
For example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
2018-06-03 11:29:28 +08:00
|
|
|
|
@pytest.mark.timeout(10, "slow", method="thread")
|
2018-03-01 07:34:20 +08:00
|
|
|
|
def test_function():
|
|
|
|
|
...
|
|
|
|
|
|
2018-04-06 00:39:57 +08:00
|
|
|
|
Will create and attach a :class:`Mark <_pytest.mark.structures.Mark>` object to the collected
|
2018-03-01 07:34:20 +08:00
|
|
|
|
:class:`Item <_pytest.nodes.Item>`, which can then be accessed by fixtures or hooks with
|
2018-04-06 00:39:57 +08:00
|
|
|
|
:meth:`Node.iter_markers <_pytest.nodes.Node.iter_markers>`. The ``mark`` object will have the following attributes:
|
2018-03-01 07:34:20 +08:00
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
2018-06-03 11:29:28 +08:00
|
|
|
|
mark.args == (10, "slow")
|
|
|
|
|
mark.kwargs == {"method": "thread"}
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
Fixtures
|
|
|
|
|
--------
|
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :ref:`fixture`.
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
Fixtures are requested by test functions or other fixtures by declaring them as argument names.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Example of a test requiring a fixture:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
def test_output(capsys):
|
2018-06-03 11:29:28 +08:00
|
|
|
|
print("hello")
|
2018-02-09 05:57:26 +08:00
|
|
|
|
out, err = capsys.readouterr()
|
2018-06-03 11:29:28 +08:00
|
|
|
|
assert out == "hello\n"
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Example of a fixture requiring another fixture:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
@pytest.fixture
|
|
|
|
|
def db_session(tmpdir):
|
2018-06-03 11:29:28 +08:00
|
|
|
|
fn = tmpdir / "db.file"
|
2018-02-09 05:57:26 +08:00
|
|
|
|
return connect(str(fn))
|
|
|
|
|
|
|
|
|
|
For more details, consult the full :ref:`fixtures docs <fixture>`.
|
|
|
|
|
|
|
|
|
|
|
2018-03-02 05:07:06 +08:00
|
|
|
|
@pytest.fixture
|
|
|
|
|
~~~~~~~~~~~~~~~
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-02 05:07:06 +08:00
|
|
|
|
.. autofunction:: pytest.fixture
|
2018-02-09 05:57:26 +08:00
|
|
|
|
:decorator:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. _`cache-api`:
|
|
|
|
|
|
|
|
|
|
config.cache
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :ref:`cache`.
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
The ``config.cache`` object allows other plugins and fixtures
|
|
|
|
|
to store and retrieve values across test runs. To access it from fixtures
|
|
|
|
|
request ``pytestconfig`` into your fixture and get it with ``pytestconfig.cache``.
|
|
|
|
|
|
|
|
|
|
Under the hood, the cache plugin uses the simple
|
|
|
|
|
``dumps``/``loads`` API of the :py:mod:`json` stdlib module.
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.cacheprovider
|
|
|
|
|
|
|
|
|
|
.. automethod:: Cache.get
|
|
|
|
|
.. automethod:: Cache.set
|
|
|
|
|
.. automethod:: Cache.makedir
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
capsys
|
|
|
|
|
~~~~~~
|
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :doc:`capture`.
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
.. currentmodule:: _pytest.capture
|
|
|
|
|
|
|
|
|
|
.. autofunction:: capsys()
|
2018-02-09 06:29:04 +08:00
|
|
|
|
:no-auto-options:
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
Returns an instance of :py:class:`CaptureFixture`.
|
|
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
def test_output(capsys):
|
|
|
|
|
print("hello")
|
|
|
|
|
captured = capsys.readouterr()
|
|
|
|
|
assert captured.out == "hello\n"
|
|
|
|
|
|
2018-03-02 10:33:21 +08:00
|
|
|
|
.. autoclass:: CaptureFixture()
|
|
|
|
|
:members:
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
capsysbinary
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :doc:`capture`.
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
.. autofunction:: capsysbinary()
|
2018-02-09 06:29:04 +08:00
|
|
|
|
:no-auto-options:
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
Returns an instance of :py:class:`CaptureFixture`.
|
|
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
def test_output(capsysbinary):
|
|
|
|
|
print("hello")
|
|
|
|
|
captured = capsysbinary.readouterr()
|
|
|
|
|
assert captured.out == b"hello\n"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
capfd
|
|
|
|
|
~~~~~~
|
|
|
|
|
|
2018-02-28 04:58:51 +08:00
|
|
|
|
**Tutorial**: :doc:`capture`.
|
|
|
|
|
|
2018-02-09 05:57:26 +08:00
|
|
|
|
.. autofunction:: capfd()
|
2018-02-09 06:29:04 +08:00
|
|
|
|
:no-auto-options:
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
|
|
|
|
Returns an instance of :py:class:`CaptureFixture`.
|
|
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
def test_system_echo(capfd):
|
|
|
|
|
os.system('echo "hello"')
|
|
|
|
|
captured = capsys.readouterr()
|
|
|
|
|
assert captured.out == "hello\n"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
capfdbinary
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`capture`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: capfdbinary()
|
|
|
|
|
:no-auto-options:
|
|
|
|
|
|
|
|
|
|
Returns an instance of :py:class:`CaptureFixture`.
|
|
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
def test_system_echo(capfdbinary):
|
|
|
|
|
os.system('echo "hello"')
|
|
|
|
|
captured = capfdbinary.readouterr()
|
|
|
|
|
assert captured.out == b"hello\n"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
doctest_namespace
|
|
|
|
|
~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`doctest`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: _pytest.doctest.doctest_namespace()
|
|
|
|
|
|
|
|
|
|
Usually this fixture is used in conjunction with another ``autouse`` fixture:
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
@pytest.fixture(autouse=True)
|
|
|
|
|
def add_np(doctest_namespace):
|
2018-06-03 11:29:28 +08:00
|
|
|
|
doctest_namespace["np"] = numpy
|
2018-03-01 07:52:41 +08:00
|
|
|
|
|
|
|
|
|
For more details: :ref:`doctest_namespace`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
request
|
|
|
|
|
~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`request example`.
|
|
|
|
|
|
|
|
|
|
The ``request`` fixture is a special fixture providing information of the requesting test function.
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.fixtures.FixtureRequest()
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
pytestconfig
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
.. autofunction:: _pytest.fixtures.pytestconfig()
|
|
|
|
|
|
|
|
|
|
|
2018-03-17 05:15:28 +08:00
|
|
|
|
record_property
|
2018-03-01 07:52:41 +08:00
|
|
|
|
~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
2018-03-17 05:15:28 +08:00
|
|
|
|
**Tutorial**: :ref:`record_property example`.
|
2018-03-01 07:52:41 +08:00
|
|
|
|
|
2018-03-17 05:15:28 +08:00
|
|
|
|
.. autofunction:: _pytest.junitxml.record_property()
|
2018-03-01 07:52:41 +08:00
|
|
|
|
|
|
|
|
|
caplog
|
|
|
|
|
~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`logging`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: _pytest.logging.caplog()
|
|
|
|
|
:no-auto-options:
|
|
|
|
|
|
|
|
|
|
This returns a :class:`_pytest.logging.LogCaptureFixture` instance.
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.logging.LogCaptureFixture
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
monkeypatch
|
|
|
|
|
~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.monkeypatch
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`monkeypatch`.
|
|
|
|
|
|
|
|
|
|
.. autofunction:: _pytest.monkeypatch.monkeypatch()
|
|
|
|
|
:no-auto-options:
|
|
|
|
|
|
|
|
|
|
This returns a :class:`MonkeyPatch` instance.
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.monkeypatch.MonkeyPatch
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
testdir
|
|
|
|
|
~~~~~~~
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.pytester
|
|
|
|
|
|
|
|
|
|
This fixture provides a :class:`Testdir` instance useful for black-box testing of test files, making it ideal to
|
|
|
|
|
test plugins.
|
|
|
|
|
|
|
|
|
|
To use it, include in your top-most ``conftest.py`` file::
|
|
|
|
|
|
|
|
|
|
pytest_plugins = 'pytester'
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. autoclass:: Testdir()
|
2018-08-20 12:11:31 +08:00
|
|
|
|
:members:
|
2018-03-01 07:52:41 +08:00
|
|
|
|
|
|
|
|
|
.. autoclass:: RunResult()
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
.. autoclass:: LineMatcher()
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
recwarn
|
|
|
|
|
~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`assertwarnings`
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.recwarn
|
|
|
|
|
|
|
|
|
|
.. autofunction:: recwarn()
|
|
|
|
|
:no-auto-options:
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.recwarn.WarningsRecorder()
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
Each recorded warning is an instance of :class:`warnings.WarningMessage`.
|
|
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
:class:`RecordedWarning` was changed from a plain class to a namedtuple in pytest 3.1
|
|
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
``DeprecationWarning`` and ``PendingDeprecationWarning`` are treated
|
|
|
|
|
differently; see :ref:`ensuring_function_triggers`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
tmpdir
|
|
|
|
|
~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`tmpdir`
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.tmpdir
|
|
|
|
|
|
|
|
|
|
.. autofunction:: tmpdir()
|
|
|
|
|
:no-auto-options:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
tmpdir_factory
|
|
|
|
|
~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`tmpdir factory example`
|
|
|
|
|
|
|
|
|
|
.. _`tmpdir factory api`:
|
|
|
|
|
|
|
|
|
|
``tmpdir_factory`` instances have the following methods:
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.tmpdir
|
|
|
|
|
|
|
|
|
|
.. automethod:: TempdirFactory.mktemp
|
|
|
|
|
.. automethod:: TempdirFactory.getbasetemp
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. _`hook-reference`:
|
|
|
|
|
|
|
|
|
|
Hooks
|
|
|
|
|
-----
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :doc:`writing_plugins`.
|
|
|
|
|
|
|
|
|
|
.. currentmodule:: _pytest.hookspec
|
|
|
|
|
|
|
|
|
|
Reference to all hooks which can be implemented by :ref:`conftest.py files <localplugin>` and :ref:`plugins <plugins>`.
|
|
|
|
|
|
|
|
|
|
Bootstrapping hooks
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
Bootstrapping hooks called for plugins registered early enough (internal and setuptools plugins).
|
|
|
|
|
|
|
|
|
|
.. autofunction:: pytest_load_initial_conftests
|
|
|
|
|
.. autofunction:: pytest_cmdline_preparse
|
|
|
|
|
.. autofunction:: pytest_cmdline_parse
|
|
|
|
|
.. autofunction:: pytest_cmdline_main
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Initialization hooks
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Initialization hooks called for plugins and ``conftest.py`` files.
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_addoption
|
2018-03-02 04:55:45 +08:00
|
|
|
|
.. autofunction:: pytest_addhooks
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_configure
|
|
|
|
|
.. autofunction:: pytest_unconfigure
|
2018-03-30 06:48:48 +08:00
|
|
|
|
.. autofunction:: pytest_sessionstart
|
|
|
|
|
.. autofunction:: pytest_sessionfinish
|
2018-02-28 04:58:51 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Test running hooks
|
|
|
|
|
~~~~~~~~~~~~~~~~~~
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
All runtest related hooks receive a :py:class:`pytest.Item <_pytest.main.Item>` object.
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_runtestloop
|
|
|
|
|
.. autofunction:: pytest_runtest_protocol
|
|
|
|
|
.. autofunction:: pytest_runtest_logstart
|
|
|
|
|
.. autofunction:: pytest_runtest_logfinish
|
|
|
|
|
.. autofunction:: pytest_runtest_setup
|
|
|
|
|
.. autofunction:: pytest_runtest_call
|
|
|
|
|
.. autofunction:: pytest_runtest_teardown
|
|
|
|
|
.. autofunction:: pytest_runtest_makereport
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
For deeper understanding you may look at the default implementation of
|
|
|
|
|
these hooks in :py:mod:`_pytest.runner` and maybe also
|
|
|
|
|
in :py:mod:`_pytest.pdb` which interacts with :py:mod:`_pytest.capture`
|
|
|
|
|
and its input/output capturing in order to immediately drop
|
|
|
|
|
into interactive debugging when a test failure occurs.
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
The :py:mod:`_pytest.terminal` reported specifically uses
|
|
|
|
|
the reporting hook to print information about a test run.
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Collection hooks
|
|
|
|
|
~~~~~~~~~~~~~~~~
|
2018-02-09 05:57:26 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
``pytest`` calls the following hooks for collecting files and directories:
|
2018-02-09 06:08:44 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_collection
|
|
|
|
|
.. autofunction:: pytest_ignore_collect
|
|
|
|
|
.. autofunction:: pytest_collect_directory
|
|
|
|
|
.. autofunction:: pytest_collect_file
|
2018-02-28 04:58:51 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
For influencing the collection of objects in Python modules
|
|
|
|
|
you can use the following hook:
|
2018-02-09 06:08:44 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_pycollect_makeitem
|
|
|
|
|
.. autofunction:: pytest_generate_tests
|
|
|
|
|
.. autofunction:: pytest_make_parametrize_id
|
2018-02-09 06:08:44 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
After collection is complete, you can modify the order of
|
|
|
|
|
items, delete or otherwise amend the test items:
|
2018-02-09 06:08:44 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_collection_modifyitems
|
2018-02-09 06:08:44 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Reporting hooks
|
|
|
|
|
~~~~~~~~~~~~~~~
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Session related reporting hooks:
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_collectstart
|
|
|
|
|
.. autofunction:: pytest_itemcollected
|
|
|
|
|
.. autofunction:: pytest_collectreport
|
|
|
|
|
.. autofunction:: pytest_deselected
|
|
|
|
|
.. autofunction:: pytest_report_header
|
|
|
|
|
.. autofunction:: pytest_report_collectionfinish
|
|
|
|
|
.. autofunction:: pytest_report_teststatus
|
|
|
|
|
.. autofunction:: pytest_terminal_summary
|
|
|
|
|
.. autofunction:: pytest_fixture_setup
|
|
|
|
|
.. autofunction:: pytest_fixture_post_finalizer
|
2018-09-04 06:27:46 +08:00
|
|
|
|
.. autofunction:: pytest_warning_captured
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
And here is the central hook for reporting about
|
|
|
|
|
test execution:
|
2018-02-28 04:58:51 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_runtest_logreport
|
2018-02-27 07:27:15 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
You can also use this hook to customize assertion representation for some
|
|
|
|
|
types:
|
2018-02-28 04:13:14 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_assertrepr_compare
|
2018-02-28 04:13:14 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Debugging/Interaction hooks
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
2018-02-28 04:19:57 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
There are few hooks which can be used for special
|
|
|
|
|
reporting or interaction with exceptions:
|
2018-02-28 04:19:57 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autofunction:: pytest_internalerror
|
|
|
|
|
.. autofunction:: pytest_keyboard_interrupt
|
|
|
|
|
.. autofunction:: pytest_exception_interact
|
|
|
|
|
.. autofunction:: pytest_enter_pdb
|
2018-02-28 04:58:51 +08:00
|
|
|
|
|
2018-02-28 04:32:34 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Objects
|
|
|
|
|
-------
|
2018-02-28 04:32:34 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Full reference to objects accessible from :ref:`fixtures <fixture>` or :ref:`hooks <hook-reference>`.
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
2018-02-28 04:32:34 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
CallInfo
|
|
|
|
|
~~~~~~~~
|
2018-02-28 04:32:34 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.runner.CallInfo()
|
2018-02-28 04:32:34 +08:00
|
|
|
|
:members:
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Class
|
|
|
|
|
~~~~~
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.python.Class()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Collector
|
|
|
|
|
~~~~~~~~~
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.nodes.Collector()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Config
|
|
|
|
|
~~~~~~
|
2018-02-28 04:48:19 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.config.Config()
|
2018-02-28 04:48:19 +08:00
|
|
|
|
:members:
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
ExceptionInfo
|
|
|
|
|
~~~~~~~~~~~~~
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest._code.ExceptionInfo
|
|
|
|
|
:members:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
FixtureDef
|
|
|
|
|
~~~~~~~~~~
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.fixtures.FixtureDef()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
FSCollector
|
|
|
|
|
~~~~~~~~~~~
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.nodes.FSCollector()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Function
|
|
|
|
|
~~~~~~~~
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.python.Function()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Item
|
|
|
|
|
~~~~
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.nodes.Item()
|
2018-02-28 05:03:35 +08:00
|
|
|
|
:members:
|
2018-03-01 07:52:41 +08:00
|
|
|
|
:show-inheritance:
|
2018-02-28 05:03:35 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
MarkDecorator
|
|
|
|
|
~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.mark.MarkDecorator
|
2018-02-28 05:03:35 +08:00
|
|
|
|
:members:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-04-06 00:39:57 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
MarkGenerator
|
|
|
|
|
~~~~~~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.mark.MarkGenerator
|
|
|
|
|
:members:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-04-06 00:39:57 +08:00
|
|
|
|
|
|
|
|
|
Mark
|
|
|
|
|
~~~~
|
|
|
|
|
|
|
|
|
|
.. autoclass:: _pytest.mark.structures.Mark
|
|
|
|
|
:members:
|
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Metafunc
|
|
|
|
|
~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.python.Metafunc
|
2018-02-28 05:26:40 +08:00
|
|
|
|
:members:
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Module
|
|
|
|
|
~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.python.Module()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Node
|
|
|
|
|
~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.nodes.Node()
|
|
|
|
|
:members:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Parser
|
2018-02-28 05:26:40 +08:00
|
|
|
|
~~~~~~
|
|
|
|
|
|
2018-06-11 22:20:24 +08:00
|
|
|
|
.. autoclass:: _pytest.config.argparsing.Parser()
|
2018-03-01 07:52:41 +08:00
|
|
|
|
:members:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
PluginManager
|
|
|
|
|
~~~~~~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: pluggy.PluginManager()
|
|
|
|
|
:members:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
PytestPluginManager
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.config.PytestPluginManager()
|
|
|
|
|
:members:
|
|
|
|
|
:undoc-members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
Session
|
|
|
|
|
~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.main.Session()
|
|
|
|
|
:members:
|
|
|
|
|
:show-inheritance:
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
TestReport
|
|
|
|
|
~~~~~~~~~~
|
2018-02-28 05:26:40 +08:00
|
|
|
|
|
2018-03-01 07:52:41 +08:00
|
|
|
|
.. autoclass:: _pytest.runner.TestReport()
|
|
|
|
|
:members:
|
|
|
|
|
:inherited-members:
|
|
|
|
|
|
|
|
|
|
_Result
|
|
|
|
|
~~~~~~~
|
|
|
|
|
|
2018-07-30 07:50:24 +08:00
|
|
|
|
.. autoclass:: pluggy.callers._Result
|
2018-03-01 07:52:41 +08:00
|
|
|
|
:members:
|
2018-03-02 05:20:55 +08:00
|
|
|
|
|
|
|
|
|
Special Variables
|
|
|
|
|
-----------------
|
|
|
|
|
|
|
|
|
|
pytest treats some global variables in a special manner when defined in a test module.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
pytest_plugins
|
|
|
|
|
~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`available installable plugins`
|
|
|
|
|
|
|
|
|
|
Can be declared at the **global** level in *test modules* and *conftest.py files* to register additional plugins.
|
|
|
|
|
Can be either a ``str`` or ``Sequence[str]``.
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
pytest_plugins = "myapp.testsupport.myplugin"
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
pytest_plugins = ("myapp.testsupport.tools", "myapp.testsupport.regression")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
pytest_mark
|
|
|
|
|
~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
**Tutorial**: :ref:`scoped-marking`
|
|
|
|
|
|
|
|
|
|
Can be declared at the **global** level in *test modules* to apply one or more :ref:`marks <marks ref>` to all
|
|
|
|
|
test functions and methods. Can be either a single mark or a sequence of marks.
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
import pytest
|
2018-06-03 11:29:28 +08:00
|
|
|
|
|
2018-03-02 05:20:55 +08:00
|
|
|
|
pytestmark = pytest.mark.webtest
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
|
|
|
|
|
|
import pytest
|
2018-06-03 11:29:28 +08:00
|
|
|
|
|
2018-03-02 05:20:55 +08:00
|
|
|
|
pytestmark = (pytest.mark.integration, pytest.mark.slow)
|
|
|
|
|
|
2018-03-07 07:40:07 +08:00
|
|
|
|
PYTEST_DONT_REWRITE (module docstring)
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
The text ``PYTEST_DONT_REWRITE`` can be add to any **module docstring** to disable
|
|
|
|
|
:ref:`assertion rewriting <assert introspection>` for that module.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Environment Variables
|
|
|
|
|
---------------------
|
|
|
|
|
|
|
|
|
|
Environment variables that can be used to change pytest's behavior.
|
|
|
|
|
|
|
|
|
|
PYTEST_ADDOPTS
|
|
|
|
|
~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
This contains a command-line (parsed by the py:mod:`shlex` module) that will be **prepended** to the command line given
|
|
|
|
|
by the user, see :ref:`adding default options` for more information.
|
|
|
|
|
|
|
|
|
|
PYTEST_DEBUG
|
|
|
|
|
~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
When set, pytest will print tracing and debug information.
|
|
|
|
|
|
|
|
|
|
PYTEST_PLUGINS
|
|
|
|
|
~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
Contains comma-separated list of modules that should be loaded as plugins:
|
|
|
|
|
|
|
|
|
|
.. code-block:: bash
|
|
|
|
|
|
2018-06-06 06:27:59 +08:00
|
|
|
|
export PYTEST_PLUGINS=mymodule.plugin,xdist
|
2018-03-07 07:40:07 +08:00
|
|
|
|
|
2018-08-07 04:17:24 +08:00
|
|
|
|
PYTEST_DISABLE_PLUGIN_AUTOLOAD
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
When set, disables plugin auto-loading through setuptools entrypoints. Only explicitly specified plugins will be
|
|
|
|
|
loaded.
|
2018-03-07 07:40:07 +08:00
|
|
|
|
|
|
|
|
|
PYTEST_CURRENT_TEST
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
This is not meant to be set by users, but is set by pytest internally with the name of the current test so other
|
|
|
|
|
processes can inspect it, see :ref:`pytest current test env` for more information.
|
|
|
|
|
|
2018-03-02 05:20:55 +08:00
|
|
|
|
|
2018-03-08 07:45:41 +08:00
|
|
|
|
.. _`ini options ref`:
|
|
|
|
|
|
|
|
|
|
Configuration Options
|
|
|
|
|
---------------------
|
|
|
|
|
|
|
|
|
|
Here is a list of builtin configuration options that may be written in a ``pytest.ini``, ``tox.ini`` or ``setup.cfg``
|
|
|
|
|
file, usually located at the root of your repository. All options must be under a ``[pytest]`` section
|
|
|
|
|
(``[tool:pytest]`` for ``setup.cfg`` files).
|
|
|
|
|
|
2019-01-10 05:52:08 +08:00
|
|
|
|
.. warning::
|
|
|
|
|
Usage of ``setup.cfg`` is not recommended unless for very simple use cases. ``.cfg``
|
|
|
|
|
files use a different parser than ``pytest.ini`` and ``tox.ini`` which might cause hard to track
|
|
|
|
|
down problems.
|
|
|
|
|
When possible, it is recommended to use the latter files to hold your pytest configuration.
|
2019-01-07 04:47:40 +08:00
|
|
|
|
|
2018-03-08 07:45:41 +08:00
|
|
|
|
Configuration file options may be overwritten in the command-line by using ``-o/--override``, which can also be
|
|
|
|
|
passed multiple times. The expected format is ``name=value``. For example::
|
|
|
|
|
|
|
|
|
|
pytest -o console_output_style=classic -o cache_dir=/tmp/mycache
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: addopts
|
|
|
|
|
|
|
|
|
|
Add the specified ``OPTS`` to the set of command line arguments as if they
|
|
|
|
|
had been specified by the user. Example: if you have this ini file content:
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
# content of pytest.ini
|
|
|
|
|
[pytest]
|
|
|
|
|
addopts = --maxfail=2 -rf # exit after 2 failures, report fail info
|
|
|
|
|
|
|
|
|
|
issuing ``pytest test_hello.py`` actually means::
|
|
|
|
|
|
|
|
|
|
pytest --maxfail=2 -rf test_hello.py
|
|
|
|
|
|
|
|
|
|
Default is to add no options.
|
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: cache_dir
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. versionadded:: 3.2
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Sets a directory where stores content of cache plugin. Default directory is
|
2018-05-30 19:24:10 +08:00
|
|
|
|
``.pytest_cache`` which is created in :ref:`rootdir <rootdir>`. Directory may be
|
2018-03-13 06:33:34 +08:00
|
|
|
|
relative or absolute path. If setting relative path, then directory is created
|
|
|
|
|
relative to :ref:`rootdir <rootdir>`. Additionally path may contain environment
|
|
|
|
|
variables, that will be expanded. For more information about cache plugin
|
|
|
|
|
please refer to :ref:`cache_provider`.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: confcutdir
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Sets a directory where search upwards for ``conftest.py`` files stops.
|
|
|
|
|
By default, pytest will stop searching for ``conftest.py`` files upwards
|
|
|
|
|
from ``pytest.ini``/``tox.ini``/``setup.cfg`` of the project if any,
|
|
|
|
|
or up to the file-system root.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: console_output_style
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. versionadded:: 3.3
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Sets the console output style while running tests:
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
* ``classic``: classic pytest output.
|
|
|
|
|
* ``progress``: like classic pytest output, but with a progress indicator.
|
2018-08-27 10:21:00 +08:00
|
|
|
|
* ``count``: like progress, but shows progress as the number of tests completed instead of a percent.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
The default is ``progress``, but you can fallback to ``classic`` if you prefer or
|
|
|
|
|
the new mode is causing unexpected problems:
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
# content of pytest.ini
|
|
|
|
|
[pytest]
|
2018-03-13 06:33:34 +08:00
|
|
|
|
console_output_style = classic
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: doctest_encoding
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. versionadded:: 3.1
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Default encoding to use to decode text files with docstrings.
|
|
|
|
|
:doc:`See how pytest handles doctests <doctest>`.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: doctest_optionflags
|
|
|
|
|
|
|
|
|
|
One or more doctest flag names from the standard ``doctest`` module.
|
|
|
|
|
:doc:`See how pytest handles doctests <doctest>`.
|
|
|
|
|
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: empty_parameter_set_mark
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. versionadded:: 3.4
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Allows to pick the action for empty parametersets in parameterization
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-05-13 18:06:09 +08:00
|
|
|
|
* ``skip`` skips tests with an empty parameterset (default)
|
|
|
|
|
* ``xfail`` marks tests with an empty parameterset as xfail(run=False)
|
2018-09-12 18:18:44 +08:00
|
|
|
|
* ``fail_at_collect`` raises an exception if parametrize collects an empty parameter set
|
2018-03-13 06:33:34 +08:00
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
# content of pytest.ini
|
|
|
|
|
[pytest]
|
|
|
|
|
empty_parameter_set_mark = xfail
|
|
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
|
|
The default value of this option is planned to change to ``xfail`` in future releases
|
|
|
|
|
as this is considered less error prone, see `#3155 <https://github.com/pytest-dev/pytest/issues/3155>`_
|
|
|
|
|
for more details.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: filterwarnings
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.1
|
|
|
|
|
|
|
|
|
|
Sets a list of filters and actions that should be taken for matched
|
|
|
|
|
warnings. By default all warnings emitted during the test session
|
|
|
|
|
will be displayed in a summary at the end of the test session.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
# content of pytest.ini
|
|
|
|
|
[pytest]
|
|
|
|
|
filterwarnings =
|
|
|
|
|
error
|
|
|
|
|
ignore::DeprecationWarning
|
|
|
|
|
|
|
|
|
|
This tells pytest to ignore deprecation warnings and turn all other warnings
|
|
|
|
|
into errors. For more information please refer to :ref:`warnings`.
|
|
|
|
|
|
2019-02-08 23:10:47 +08:00
|
|
|
|
.. confval:: junit_family
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 4.2
|
|
|
|
|
|
|
|
|
|
Configures the format of the generated JUnit XML file. The possible options are:
|
|
|
|
|
|
|
|
|
|
* ``xunit1`` (or ``legacy``): produces old style output, compatible with the xunit 1.0 format. **This is the default**.
|
|
|
|
|
* ``xunit2``: produces `xunit 2.0 style output <https://github.com/jenkinsci/xunit-plugin/blob/xunit-2.3.2/src/main/resources/org/jenkinsci/plugins/xunit/types/model/xsd/junit-10.xsd>`__,
|
|
|
|
|
which should be more compatible with latest Jenkins versions.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
junit_family = xunit2
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: junit_suite_name
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. versionadded:: 3.1
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
To set the name of the root test suite xml item, you can configure the ``junit_suite_name`` option in your config file:
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. code-block:: ini
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
[pytest]
|
|
|
|
|
junit_suite_name = my_suite
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 07:09:05 +08:00
|
|
|
|
.. confval:: log_cli_date_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:func:`time.strftime`-compatible string that will be used when formatting dates for live logging.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_cli_date_format = %Y-%m-%d %H:%M:%S
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`live_logs`.
|
|
|
|
|
|
|
|
|
|
.. confval:: log_cli_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:mod:`logging`-compatible string used to format live logging messages.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_cli_format = %(asctime)s %(levelname)s %(message)s
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`live_logs`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_cli_level
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets the minimum log message level that should be captured for live logging. The integer value or
|
|
|
|
|
the names of the levels can be used.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
2018-03-23 00:02:30 +08:00
|
|
|
|
log_cli_level = INFO
|
2018-03-13 07:09:05 +08:00
|
|
|
|
|
|
|
|
|
For more information, see :ref:`live_logs`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_date_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:func:`time.strftime`-compatible string that will be used when formatting dates for logging capture.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_date_format = %Y-%m-%d %H:%M:%S
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_file
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a file name relative to the ``pytest.ini`` file where log messages should be written to, in addition
|
|
|
|
|
to the other logging facilities that are active.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_file = logs/pytest-logs.txt
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_file_date_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:func:`time.strftime`-compatible string that will be used when formatting dates for the logging file.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_file_date_format = %Y-%m-%d %H:%M:%S
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
.. confval:: log_file_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:mod:`logging`-compatible string used to format logging messages redirected to the logging file.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_file_format = %(asctime)s %(levelname)s %(message)s
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
.. confval:: log_file_level
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets the minimum log message level that should be captured for the logging file. The integer value or
|
|
|
|
|
the names of the levels can be used.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_file_level = INFO
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_format
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets a :py:mod:`logging`-compatible string used to format captured logging messages.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_format = %(asctime)s %(levelname)s %(message)s
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_level
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
Sets the minimum log message level that should be captured for logging capture. The integer value or
|
|
|
|
|
the names of the levels can be used.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_level = INFO
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: log_print
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 3.3
|
|
|
|
|
|
|
|
|
|
If set to ``False``, will disable displaying captured logging messages for failed tests.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
log_print = False
|
|
|
|
|
|
|
|
|
|
For more information, see :ref:`logging`.
|
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:43:04 +08:00
|
|
|
|
.. confval:: markers
|
|
|
|
|
|
|
|
|
|
List of markers that are allowed in test functions, enforced when ``--strict`` command-line argument is used.
|
|
|
|
|
You can use a marker name per line, indented from the option name.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
markers =
|
|
|
|
|
slow
|
|
|
|
|
serial
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: minversion
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Specifies a minimal pytest version required for running tests.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
# content of pytest.ini
|
|
|
|
|
[pytest]
|
2018-03-13 06:33:34 +08:00
|
|
|
|
minversion = 3.0 # will fail if we run with pytest-2.8
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: norecursedirs
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Set the directory basename patterns to avoid when recursing
|
|
|
|
|
for test discovery. The individual (fnmatch-style) patterns are
|
|
|
|
|
applied to the basename of a directory to decide if to recurse into it.
|
|
|
|
|
Pattern matching characters::
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
* matches everything
|
|
|
|
|
? matches any single character
|
|
|
|
|
[seq] matches any character in seq
|
|
|
|
|
[!seq] matches any char not in seq
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Default patterns are ``'.*', 'build', 'dist', 'CVS', '_darcs', '{arch}', '*.egg', 'venv'``.
|
|
|
|
|
Setting a ``norecursedirs`` replaces the default. Here is an example of
|
|
|
|
|
how to avoid certain directories:
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. code-block:: ini
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
[pytest]
|
|
|
|
|
norecursedirs = .svn _build tmp*
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
This would tell ``pytest`` to not look into typical subversion or
|
|
|
|
|
sphinx-build directories or into any ``tmp`` prefixed directory.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
Additionally, ``pytest`` will attempt to intelligently identify and ignore a
|
|
|
|
|
virtualenv by the presence of an activation script. Any directory deemed to
|
|
|
|
|
be the root of a virtual environment will not be considered during test
|
|
|
|
|
collection unless ``‑‑collect‑in‑virtualenv`` is given. Note also that
|
|
|
|
|
``norecursedirs`` takes precedence over ``‑‑collect‑in‑virtualenv``; e.g. if
|
|
|
|
|
you intend to run tests in a virtualenv with a base directory that matches
|
|
|
|
|
``'.*'`` you *must* override ``norecursedirs`` in addition to using the
|
|
|
|
|
``‑‑collect‑in‑virtualenv`` flag.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. confval:: python_classes
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
One or more name prefixes or glob-style patterns determining which classes
|
2018-08-22 21:37:35 +08:00
|
|
|
|
are considered for test collection. Search for multiple glob patterns by
|
|
|
|
|
adding a space between patterns. By default, pytest will consider any
|
2018-03-13 06:33:34 +08:00
|
|
|
|
class prefixed with ``Test`` as a test collection. Here is an example of how
|
|
|
|
|
to collect tests from classes that end in ``Suite``:
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
.. code-block:: ini
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
[pytest]
|
|
|
|
|
python_classes = *Suite
|
|
|
|
|
|
|
|
|
|
Note that ``unittest.TestCase`` derived classes are always collected
|
|
|
|
|
regardless of this option, as ``unittest``'s own collection framework is used
|
|
|
|
|
to collect those tests.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: python_files
|
|
|
|
|
|
|
|
|
|
One or more Glob-style file patterns determining which python files
|
2018-08-22 21:37:35 +08:00
|
|
|
|
are considered as test modules. Search for multiple glob patterns by
|
2018-09-15 04:20:22 +08:00
|
|
|
|
adding a space between patterns:
|
2018-08-22 21:37:35 +08:00
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
python_files = test_*.py check_*.py example_*.py
|
|
|
|
|
|
2018-09-15 04:20:22 +08:00
|
|
|
|
Or one per line:
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
python_files =
|
|
|
|
|
test_*.py
|
|
|
|
|
check_*.py
|
|
|
|
|
example_*.py
|
|
|
|
|
|
|
|
|
|
By default, files matching ``test_*.py`` and ``*_test.py`` will be considered
|
|
|
|
|
test modules.
|
2018-03-13 06:33:34 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: python_functions
|
|
|
|
|
|
|
|
|
|
One or more name prefixes or glob-patterns determining which test functions
|
2018-08-22 21:37:35 +08:00
|
|
|
|
and methods are considered tests. Search for multiple glob patterns by
|
|
|
|
|
adding a space between patterns. By default, pytest will consider any
|
2018-03-13 06:33:34 +08:00
|
|
|
|
function prefixed with ``test`` as a test. Here is an example of how
|
|
|
|
|
to collect test functions and methods that end in ``_test``:
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
|
|
|
|
[pytest]
|
2018-03-13 06:33:34 +08:00
|
|
|
|
python_functions = *_test
|
|
|
|
|
|
|
|
|
|
Note that this has no effect on methods that live on a ``unittest
|
|
|
|
|
.TestCase`` derived class, as ``unittest``'s own collection framework is used
|
|
|
|
|
to collect those tests.
|
|
|
|
|
|
|
|
|
|
See :ref:`change naming conventions` for more detailed examples.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: testpaths
|
|
|
|
|
|
|
|
|
|
.. versionadded:: 2.8
|
|
|
|
|
|
|
|
|
|
Sets list of directories that should be searched for tests when
|
|
|
|
|
no specific directories, files or test ids are given in the command line when
|
|
|
|
|
executing pytest from the :ref:`rootdir <rootdir>` directory.
|
|
|
|
|
Useful when all project tests are in a known location to speed up
|
|
|
|
|
test collection and to avoid picking up undesired tests by accident.
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
[pytest]
|
|
|
|
|
testpaths = testing doc
|
2018-03-13 06:27:17 +08:00
|
|
|
|
|
2018-03-13 06:33:34 +08:00
|
|
|
|
This tells pytest to only look for tests in ``testing`` and ``doc``
|
|
|
|
|
directories when executing from the root directory.
|
2018-03-08 07:45:41 +08:00
|
|
|
|
|
2018-03-13 06:43:04 +08:00
|
|
|
|
|
|
|
|
|
.. confval:: usefixtures
|
|
|
|
|
|
|
|
|
|
List of fixtures that will be applied to all test functions; this is semantically the same to apply
|
|
|
|
|
the ``@pytest.mark.usefixtures`` marker to all test functions.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
usefixtures =
|
|
|
|
|
clean_db
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. confval:: xfail_strict
|
|
|
|
|
|
|
|
|
|
If set to ``True``, tests marked with ``@pytest.mark.xfail`` that actually succeed will by default fail the
|
|
|
|
|
test suite.
|
|
|
|
|
For more information, see :ref:`xfail strict tutorial`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.. code-block:: ini
|
|
|
|
|
|
|
|
|
|
[pytest]
|
|
|
|
|
xfail_strict = True
|