I have trouble using third party plugins in my frozen program and discovered
that other people have experienced it as well:
https://mail.python.org/pipermail//pytest-dev/2015-June/003015.html
The problem is that the mechanism for plugin discovery used by pytest
(setupttools entry points) doesn't work with frozen executables so pytest
can't find any plugins. The solution seems to be to import the third party
plugins explicitly as shown here:
https://mail.python.org/pipermail//pytest-dev/2015-June/003018.html
This is not mentioned anywhere in the documentaion.