holger krekel
93f91c9607
unify handling of reportcharacters across resultlog/junitxml plugins
...
--HG--
branch : trunk
2010-05-20 14:35:13 +02:00
holger krekel
925f75088d
fix issue91 introduce new py.test.xfail(reason) helper
...
to imperatively mark a test as expected to fail. Can
be used from within setup and test functions. This is
useful especially for parametrized tests when certain
configurations are expected-to-fail. In this case the
declarative approach with the @py.test.mark.xfail cannot
be used as it would mark all configurations as xfail.
--HG--
branch : trunk
2010-05-20 13:29:51 +02:00
holger krekel
eac0345689
fix wrong test invocation
...
--HG--
branch : trunk
2010-05-19 17:05:13 +02:00
holger krekel
20424a9c76
fix and test "-rP" option to show xpass-test ids
...
--HG--
branch : trunk
2010-05-19 16:52:03 +02:00
holger krekel
2229d2d947
revert 1735 - fix issue95 differently: just shift the offending zlib
...
import (and others) to happen when they are actually needed
--HG--
branch : trunk
2010-05-19 16:42:22 +02:00
holger krekel
c3bd29b490
fix issue95 - treat a failing pytest_genscript import
...
as non-critical, give a hint.
--HG--
branch : trunk
2010-05-19 16:22:23 +02:00
holger krekel
4f5d7948f7
- try to fix the nightly failures by refining internal capturing mechanism
...
and adding tests, including a "lsof" test for making sure the number of
open file descriptors does not increase.
- also move a py.io related logging test to testing/io
--HG--
branch : trunk
2010-05-18 16:01:58 +02:00
holger krekel
1a97c59439
fix test to account for earlier capfd skipping (on jython)
...
--HG--
branch : trunk
2010-05-18 09:54:04 +02:00
holger krekel
e71685736e
fix issue96 - make capturing more resilient against KeyboardInterrupt
...
--HG--
branch : trunk
2010-05-17 19:00:39 +02:00
holger krekel
379390a8aa
remove code.new() function and store lines directly into linecache.cache instead.
...
This avoids the need for custom code objects, improving compatibility for jython
and pypy-c.
--HG--
branch : trunk
2010-05-11 22:54:04 +02:00
holger krekel
ee036223ce
deprecate --report option in favour of a new shorter and easier to remember -r option: this takes a string argument consisting of any combination of 'xsfX'
...
Those letters basically correspond to the letters you see during terminal reporting.
--HG--
branch : trunk
2010-05-05 19:50:59 +02:00
holger krekel
c933ada7fb
new --runxfail option to ignore xfail markers on functions
...
--HG--
branch : trunk
2010-05-04 13:02:27 +02:00
holger krekel
28150c7486
add unit-tests for xfail and refine xfail handling and reporting
...
--HG--
branch : trunk
2010-05-04 12:37:56 +02:00
holger krekel
dd7fd97810
add a terminalreporter.testid method
...
--HG--
branch : trunk
2010-05-04 12:37:52 +02:00
holger krekel
1a8b2838fa
add new parameters:
...
xfail(run=False) will not run expected-to-fail tests
xfail(reason=True) will report the specified reason
--HG--
branch : trunk
2010-05-02 22:13:16 +02:00
holger krekel
82d4aae571
some internal fixes regarding the new required hook-finding prefix
...
--HG--
branch : trunk
2010-05-02 17:10:38 +02:00
Benjamin Peterson
d93016d85f
remove the unused return value of fnmatch_lines
...
--HG--
branch : trunk
2010-04-28 17:12:38 -05:00
holger krekel
22a50a5b88
* various jython related fixes.
...
* more care for print-errors including unicode-encoding related errors.
--HG--
branch : trunk
2010-04-28 15:24:38 +02:00
holger krekel
78d33a2f28
* rather expose internal exceptions under py.test.ACTION.Exception
...
with ACTION being skip, fail, exit, raises.
* move and refine test_outcome.py tests into runner tests
--HG--
branch : trunk
2010-04-28 08:42:56 +02:00
holger krekel
d5e463605e
* properly expose and document runtest-protocol related Exceptions
...
and move all definitions to the runner plugin for now.
* also move EXIT codes to session.py, obsoleting outcome.py alltogether.
--HG--
branch : trunk
2010-04-27 21:13:09 +02:00
holger krekel
ed7a2d2da3
refine/fix isimportable-logic and ensure that 'tmpdir' has a python-importable name
...
--HG--
branch : trunk
2010-04-27 16:10:25 +02:00
holger krekel
c8d78177b9
(fixes issue85) correctly write non-ascii test output to junitxml files, refine some internal methods for it
...
--HG--
branch : trunk
2010-04-27 15:15:43 +02:00
Benjamin Peterson
7629b8fda7
make test source syntax valid
...
--HG--
branch : trunk
2010-04-23 20:49:00 -05:00
holger krekel
b3a05b545e
another couple of checks on jython, still some problems
...
--HG--
branch : trunk
2010-04-23 19:05:22 +02:00
holger krekel
85d35f7418
introduce an experimental approach for allowing dynamic addition of hooks from plugin. Plugins may register new hooks by implementing the new
...
pytest_registerhooks(pluginmanager)
and call
pluginmanager.registerhooks(module)
with the referenced 'module' object containing the hooks.
The new pytest_registerhooks is called after pytest_addoption
and before pytest_configure.
--HG--
branch : trunk
2010-04-22 11:57:57 +02:00
holger krekel
061f4c1515
robustify check
...
--HG--
branch : trunk
2010-04-21 14:46:41 +02:00
holger krekel
c7326f1949
fix a pdb problem when dropping to a "raises" related failure
...
--HG--
branch : trunk
2010-02-08 14:17:01 +01:00
holger krekel
105ed6dcaa
fix this test
...
--HG--
branch : trunk
2010-02-05 22:57:46 +01:00
holger krekel
3234e6e978
add a --funcargs option showing available funcargs
...
--HG--
branch : trunk
2010-02-04 23:45:07 +01:00
holger krekel
9d64d7e27a
refine setup ordering some more - test and avoid a problem with funcarg setups where the
...
surrounding setup_module would fail, but the funcarg setup still be called (which might
assume that setup_module has been called so would raise a confusing error)
--HG--
branch : trunk
2010-01-28 15:36:27 +01:00
holger krekel
a2af204687
again addresses issue78 : we now call teardown also if setup raised a Skipped exception.
...
I also made sure, setup_module/class will only be called once - before they'd be call again
and again if they raise an error or a skip - for each test in their scope.
--HG--
branch : trunk
2010-01-28 14:20:58 +01:00
holger krekel
98608611af
closes #67 new super-short traceback-printing option: "--tb=line" will print a single line for each failing (python) test indicating its filename, lineno and the failure value
...
--HG--
branch : trunk
2010-01-27 12:52:19 +01:00
holger krekel
b18ab6e03b
fix issue78 - now python-level teardown functions are now called even if the setup failed.
...
Important detail: if the setup raises a Skipped exception, teardown will not be called. This helps
to avoid breaking setup_module/class that performs a skip - it would otherwise internally
be considered as a "successful" setup in order to have teardown called later. I guess
it also makes sense to treat Skip specially because it is unlikely a teardown should be
called if a Skip was raised on setup.
In any case, failing setups and teardowns will be reported separately.
--HG--
branch : trunk
2010-01-27 12:09:30 +01:00
holger krekel
d3c0ff3a1f
make sure we get an absolute path when writing the genscript file
...
--HG--
branch : trunk
2010-01-18 16:48:20 +01:00
holger krekel
d483f18374
move rsync reporting out
...
--HG--
branch : trunk
2010-01-18 00:41:22 +01:00
holger krekel
95de17b652
refine tests and refine code to deal with new xdist semantics.
...
--HG--
branch : trunk
2010-01-17 23:23:02 +01:00
holger krekel
09671eb6fc
rename logxml plugin to junitxml
...
--HG--
branch : trunk
2010-01-16 23:33:26 +01:00
holger krekel
9da1ba40ed
move down py/impl/XYZ to py/_XYZ
...
--HG--
branch : trunk
2010-01-13 17:15:54 +01:00
holger krekel
40f41496d8
remove dist-testing and looponfail code from core. there remain some (pytest_runner particularly) tests that test both plain and dist modes which cannot be easily dis-entangled. food for thought.
...
--HG--
branch : trunk
2010-01-13 16:00:33 +01:00
holger krekel
d4f5073076
remove figleaf which now lives "outside"
...
--HG--
branch : trunk
2010-01-13 00:47:20 +01:00
holger krekel
d53572a710
introduce a new pytest_report_header(hook) hook to add additional test-run relevant information to the header of a test report.
...
--HG--
branch : trunk
2010-01-12 21:43:25 +01:00
holger krekel
8d9e0712be
refine classname normalization for junit-xml
...
--HG--
branch : trunk
2010-01-12 01:35:50 +01:00
holger krekel
ba1451330e
refine rsyncing and internal dir/transferal handling: don't transfer roots in a popen- no-chdir situation and only use one py._pydir everywhere
...
--HG--
branch : trunk
2010-01-11 14:30:50 +01:00
holger krekel
3029aa6558
fix some "import py" test issues, and prevent "genscript" script from having dist-options
...
--HG--
branch : trunk
2010-01-10 20:45:37 +01:00
holger krekel
27aa14c20f
fix python3 issues, add missing plugin docs
...
--HG--
branch : trunk
2010-01-03 13:27:06 +01:00
holger krekel
1b34492108
vastly simplify and cleanup collection initialization by internally
...
introducing a RootCollector. Note that the internal node
methods _fromtrail and _totrail are shifted to the still internal
config._rootcol.fromtrail/totrail
--HG--
branch : trunk
2010-01-03 01:02:44 +01:00
holger krekel
eebeb1b257
enable doctest plugin by default, add a --doctest-glob option and some documentation, regen plugin docs.
...
--HG--
branch : trunk
2010-01-02 23:30:46 +01:00
holger krekel
56a936993c
enhance figleaf setup, enabled by default now (requires --figleaf). Generalize internal ability to show "hints" at the end of "-h".
...
--HG--
branch : trunk
2010-01-02 22:48:53 +01:00
holger krekel
a20e60aeae
slightly refine invocation of py.test: use the py lib that we got invoked with,
...
does away with the need to not-chdir some tests
--HG--
branch : trunk
2010-01-02 11:57:42 +01:00
holger krekel
e0dd171e45
fix standalone script generation on windows, make tests not do a chdir() so that distributed testing discovers the transferred lib
...
--HG--
branch : trunk
2010-01-01 21:54:27 +01:00