I find some strange results using testthat. At startup test_file, individual calls are detected test_that, but the console does not display output other than the context name, and the return data.framedoes not have the expected results. I suspect I'm doing something really dumb, but I tried many alternatives and got the same result.
Here is my file tests.r:
context("The context")
test_that('should pass',function(){
expect_equal(42,42)
})
test_that('should fail',function(){
expect_equal(43,42)
})
test_that('should error',function(){
stop()
})
I ran on it test_file:
> require(testthat)
Loading required package: testthat
> test_file('tests.r')
The context :
> results <- test_file('tests.r')
The context :
> results
file context test nb failed error user system real
1 tests.r The context should pass 0 0 FALSE 0 0 0.002
2 tests.r The context should fail 0 0 FALSE 0 0 0.001
3 tests.r The context should error 0 0 FALSE 0 0 0.001
As you can see, no console output in the results, data.frameinstead of having one failed test, and one with an error, looks as if everything has passed.
When I run function bodies directly in the console, I get the expected:
> expect_equal(42,42)
> expect_equal(43,42)
Error: 43 not equal to 42
Mean relative difference: 0.02380952
> stop()
Error:
This is what I run:
> sessionInfo()
R version 3.1.2 (2014-10-31)
Platform: x86_64-pc-linux-gnu (64-bit)
locale:
[1] LC_CTYPE=en_NZ.UTF-8 LC_NUMERIC=C
[3] LC_TIME=en_NZ.UTF-8 LC_COLLATE=en_NZ.UTF-8
[5] LC_MONETARY=en_NZ.UTF-8 LC_MESSAGES=en_NZ.UTF-8
[7] LC_PAPER=en_NZ.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C
[11] LC_MEASUREMENT=en_NZ.UTF-8 LC_IDENTIFICATION=C
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] testthat_0.9.1
, -, Ubuntu Trusty/R 3.12 Windows 7/R 3.11 . - !
, Runit:
test.should_pass <- function(){
checkEquals(42,42)
}
test.should_fail <- function(){
checkEquals(43,42)
}
test.should_error <- function(){
stop()
}
:
> results <- runTestFile('tests.r')
Executing test function test.should_error ... Timing stopped at: 0 0 0
Error in func() :
done successfully.
Executing test function test.should_fail ... Timing stopped at: 0 0 0.001
Error in checkEquals(43, 42) : Mean relative difference: 0.02325581
done successfully.
Executing test function test.should_pass ... done successfully.
> results
Number of test functions: 3
Number of errors: 1
Number of failures: 1