runc/tests/integration
Zhang Wei 9192b052b2 Fix integration when missing criu
If criu isn't installed in the host, integration tests won't be able
to go on, it should skip checkpoint/restore tests instead of interrupt.

Output before:

```
$ make localintegration
bats -t tests/integration
/usr/lib/bats/bats-exec-suite: line 20: let: count+=: syntax error:
operand expected (error token is "+=")
Makefile:103: recipe for target 'localintegration' failed
```

Signed-off-by: Zhang Wei <zhangwei555@huawei.com>
2017-07-14 20:15:20 +08:00
..
testdata adds integration tests 2016-04-21 19:09:27 -05:00
README.md Updating README for starting the container 2016-06-05 14:41:58 +05:30
cgroups.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
checkpoint.bats print out errors in checkpoint/restore log 2017-06-25 16:01:36 +01:00
create.bats tests: fix all the things 2016-12-01 15:49:37 +11:00
debug.bats Rename start to run 2016-05-31 11:06:41 -07:00
delete.bats Ignore error when force deleting a non-existing container 2017-05-16 22:23:00 +02:00
events.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
exec.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
help.bats tests: add rootless integration tests 2017-03-23 20:46:22 +11:00
helpers.bash Fix integration when missing criu 2017-07-14 20:15:20 +08:00
kill.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
list.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
mask.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
pause.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
ps.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
root.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
spec.bats vendor: clean up to be better written 2017-04-25 10:46:48 +10:00
start.bats Only allow single container operation 2017-03-08 10:02:39 +08:00
start_detached.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
start_hello.bats tests: add rootless integration tests 2017-03-23 20:46:22 +11:00
state.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
tty.bats tests: don't call wait_for_container after synchronous operations 2017-05-02 21:48:07 +03:00
update.bats Update spec to 239c4e44f2 2017-06-01 16:29:47 -07:00
version.bats bats: refactor run "$RUNC" -> runc 2016-05-26 19:17:39 +10:00

README.md

runc Integration Tests

Integration tests provide end-to-end testing of runc.

Note that integration tests do not replace unit tests.

As a rule of thumb, code should be tested thoroughly with unit tests. Integration tests on the other hand are meant to test a specific feature end to end.

Integration tests are written in bash using the bats framework.

Running integration tests

The easiest way to run integration tests is with Docker:

$ make integration

Alternatively, you can run integration tests directly on your host through make:

$ sudo make localintegration

Or you can just run them directly using bats

$ sudo bats tests/integration

To run a single test bucket:

$ make integration TESTFLAGS="/checkpoint.bats"

To run them on your host, you will need to setup a development environment plus bats For example:

$ cd ~/go/src/github.com
$ git clone https://github.com/sstephenson/bats.git
$ cd bats
$ ./install.sh /usr/local

Note: There are known issues running the integration tests using devicemapper as a storage driver, make sure that your docker daemon is using aufs if you want to successfully run the integration tests.

Writing integration tests

[helper functions] (https://github.com/opencontainers/runc/blob/master/test/integration/helpers.bash) are provided in order to facilitate writing tests.

#!/usr/bin/env bats

# This will load the helpers.
load helpers

# setup is called at the beginning of every test.
function setup() {
  # see functions teardown_hello and setup_hello in helpers.bash, used to
  # create a pristine environment for running your tests
  teardown_hello
  setup_hello
}

# teardown is called at the end of every test.
function teardown() {
  teardown_hello
}

@test "this is a simple test" {
  runc run containerid
  # "The runc macro" automatically populates $status, $output and $lines.
  # Please refer to bats documentation to find out more.
  [ "$status" -eq 0 ]

  # check expected output
  [[ "${output}" == *"Hello"* ]]
}