p34709852
/
monkey
forked from p15670423/monkey
1
0
Fork 1
Code Issues Pull Requests Projects Releases Wiki Activity
monkey/envs/monkey_zoo/blackbox
History
Mike Salvatore 646b3a1b46 BB: Add `simplify=True` to Credentials serialization 2022-09-07 11:48:33 +00:00
..
analyzers BB: Fix Zerologon analyzer 2022-07-28 11:52:42 +02:00
island_client BB: Add `simplify=True` to Credentials serialization 2022-09-07 11:48:33 +00:00
log_handlers BB: Add __test__ to some untestable classes 2022-07-26 16:31:35 +02:00
test_configurations BB: Add contained type to _propagation_credentials type hint 2022-09-06 10:10:08 -04:00
tests BB: Reset Island after finished test 2022-07-26 16:29:21 +02:00
utils BB: Remove config_generation_script.py 2022-07-22 17:24:53 +00:00
README.md BB, Island: Remove BB performance tests and *everything* related to it 2022-07-22 17:24:53 +00:00
__init__.py Basic skeleton for blackbox script 2019-08-27 15:52:39 +03:00
conftest.py BB: Rename list_machines -> gcp_machines_to_start 2022-08-10 14:23:16 -04:00
gcp_test_machine_list.py BB: Add starting GCP machines of single tests 2022-07-27 15:03:29 +02:00
pytest.ini Added module + filename + line number to logs output in Blackbox 2019-10-07 13:49:13 +03:00
start_all_gcp_machines.py Zoo: Remove GCPHandler class. Powershell-3-47 renamed to 2021-08-24 15:11:22 +02:00
stop_all_gcp_machines.py Zoo: Remove GCPHandler class. Powershell-3-47 renamed to 2021-08-24 15:11:22 +02:00
test_blackbox.py BB: Rename list_machines -> gcp_machines_to_start 2022-08-10 14:23:16 -04:00

README.md

Automatic blackbox tests

Prerequisites

  1. Download google sdk: https://cloud.google.com/sdk/docs/
  2. Download service account key for MonkeyZoo project (if you deployed MonkeyZoo via terraform scripts then you already have it). GCP console -> IAM -> service accounts(you can use the same key used to authenticate terraform scripts). Place the key in envs/monkey_zoo/gcp_keys/gcp_key.json.
  3. Deploy the relevant branch + complied executables to the Island machine on GCP.

Running the tests

In order to execute the entire test suite, you must know the external IP of the Island machine on GCP. You can find this information in the GCP Console Compute Engine/VM Instances under External IP.

Running in command line

Either run pytest from /monkey directory or set PYTHONPATH environment variable to /monkey directory so that blackbox tests can import other monkey code. Blackbox tests have following parameters:

  • --island=IP Sets island's IP
  • --no-gcp (Optional) Use for no interaction with the cloud (local test).

Example run command:

monkey\monkey>python -m pytest -s --island=35.207.152.72:5000 ..\envs\monkey_zoo\blackbox\test_blackbox.py

Running in PyCharm

Configure a PyTest configuration with the additional arguments -s --island=35.207.152.72:5000, and to run from directory monkey\envs\monkey_zoo\blackbox.