travis-ci: run previously failed tests first, then slowest to fastest

The Travis-CI machines are in a clean state in the beginning of every run (transient by default). Use the Travis-CI cache feature to make the prove state persistent across consecutive Travis-CI runs on the same branch. This allows to run previously failed tests first and run remaining tests in slowest to fastest order. As a result it is less likely that Travis-CI needs to wait for a single test at the end which speeds up the test suite execution by ~2 min. Travis-CI can only cache entire directories. Prove stores the .prove file always in the t/ directory but we don't want to cache the entire t/ directory. Therefore we create a symlink from $HOME/travis-cache/.prove to t/.prove and cache the $HOME/travis-cache directory. Unfortunately the cache feature is only available (for free) on the Travis-CI Linux environment. Suggested-by: Jeff King <peff@peff.net> Signed-off-by: Lars Schneider <larsxschneider@gmail.com> Signed-off-by: Junio C Hamano <gitster@pobox.com>

Lars Schneider committed Jan 26, 2016 at 10:53 UTC 6272ed319462650e008f79cfab3aef233dc849b7
1 file changed +7 -1
.travis.yml
+7 -1
@@ -1,5 +1,9 @@
1 language: c
2
3 +cache:
4 + directories:
5 + - $HOME/travis-cache
6 +
7 os:
8 - linux
9 - osx
@@ -18,7 +22,7 @@ env:
22 - P4_VERSION="15.2"
23 - GIT_LFS_VERSION="1.1.0"
24 - DEFAULT_TEST_TARGET=prove
21 - - GIT_PROVE_OPTS="--timer --jobs 3"
25 + - GIT_PROVE_OPTS="--timer --jobs 3 --state=failed,slow,save"
26 - GIT_TEST_OPTS="--verbose --tee"
27 - CFLAGS="-g -O2 -Wall -Werror"
28 - GIT_TEST_CLONE_2GB=YesPlease
@@ -67,6 +71,8 @@ before_install:
71 p4 -V | grep Rev.;
72 echo "$(tput setaf 6)Git-LFS Version$(tput sgr0)";
73 git-lfs version;
74 + mkdir -p $HOME/travis-cache;
75 + ln -s $HOME/travis-cache/.prove t/.prove;
76
77 before_script: make --jobs=2
78