marian-nmt / amun Goto Github PK

[...truncated 1.69 KB...]
-- The CXX compiler identification is GNU 5.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Forcing compilation without CUDA.
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Boost version: 1.58.0
-- Found the following Boost libraries:
--   system
--   filesystem
--   program_options
--   timer
--   iostreams
--   python
--   thread
--   chrono
--   regex
--   date_time
--   atomic
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython2.7.so (found suitable version "2.7.12", minimum required is "2.7") 
-- Found Python
-- Found ZLIB: /usr/local/lib/libz.so (found version "1.2.8") 
-- Found Git: /usr/bin/git (found version "2.7.4") 
-- Git version: 8f54edd
-- Found SparseHash: /usr/include  
-- Configuring done
-- Generating done
-- Build files have been written to: /var/lib/jenkins/workspace/amun-cpu/build
+ make -j4 BrokenIntentionallyForTesting
make: *** No rule to make target 'BrokenIntentionallyForTesting'. Stop.
Build step 'Execute shell' marked build as failure
Archiving artifacts

[...truncated 9.43 KB...]
[ 71%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/history.cpp.o
[ 73%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/histories.cpp.o
[ 74%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/hypothesis.cpp.o
[ 75%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/loader.cpp.o
[ 76%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/logging.cpp.o
[ 78%] Building CXX object src/amun/CMakeFiles/cpumode.dir/cpu/nematus/gru.cpp.o
[ 79%] Building CXX object src/amun/CMakeFiles/cpumode.dir/cpu/nematus/transition.cpp.o
[ 80%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/output_collector.cpp.o
[ 81%] Building CXX object src/amun/CMakeFiles/cpumode.dir/cpu/nematus/encoder_decoder.cpp.o
[ 82%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/printer.cpp.o
[ 84%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/processor/bpe.cpp.o
[ 85%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/scorer.cpp.o
[ 86%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/search.cpp.o
[ 87%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/sentence.cpp.o
[ 89%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/sentences.cpp.o
[ 90%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/types.cpp.o
[ 91%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/utils.cpp.o
[ 92%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/vocab.cpp.o
[ 93%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/factor_vocab.cpp.o
[ 95%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/base_tensor.cpp.o
[ 96%] Building CXX object src/amun/CMakeFiles/libcommon.dir/common/translation_task.cpp.o
[ 96%] Built target cpumode
[ 96%] Built target libcommon
Scanning dependencies of target amun
[ 97%] Building CXX object src/amun/CMakeFiles/amun.dir/common/loader_factory.cpp.o
[ 98%] Building CXX object src/amun/CMakeFiles/amun.dir/common/decoder_main.cpp.o
[100%] Linking CXX executable ../../amun
[100%] Built target amun
+ make -j4 python
[  1%] Built target libcnpy
[ 41%] Built target libyaml-cpp-amun
[ 75%] Built target libcommon
[ 95%] Built target cpumode
Scanning dependencies of target python
[ 97%] Building CXX object src/amun/CMakeFiles/python.dir/python/amunmt.cpp.o
[ 98%] Building CXX object src/amun/CMakeFiles/python.dir/common/loader_factory.cpp.o
[100%] Linking CXX shared library ../../libamunmt.so
[100%] Built target python
+ cd ..
+ tar zcvf amun-cpu.tgz build/amun build/atools build/extract_lex build/fast_align build/libamunmt.so
build/amun
build/atools
build/extract_lex
build/fast_align
build/libamunmt.so
+ This job run is intentionally broken...
/tmp/jenkins8457261435458627666.sh: 10: /tmp/jenkins8457261435458627666.sh: This: not found
Build step 'Execute shell' marked build as failure
Archiving artifacts

Started by upstream project "amun-gpu" build number 5
originally caused by:
 Started by GitHub push by hieuhoang
 Started by GitHub push by hieuhoang
Running as SYSTEM
Building remotely on var (vnni) in workspace /var/lib/jenkins/workspace/amun-regression-tests-gpu
Cloning the remote Git repository
Cloning repository http://github.com/marian-nmt/amun-regression-tests
 > git init /var/lib/jenkins/workspace/amun-regression-tests-gpu # timeout=10
Fetching upstream changes from http://github.com/marian-nmt/amun-regression-tests
 > git --version # timeout=10
 > git fetch --tags --progress http://github.com/marian-nmt/amun-regression-tests +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url http://github.com/marian-nmt/amun-regression-tests # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url http://github.com/marian-nmt/amun-regression-tests # timeout=10
Fetching upstream changes from http://github.com/marian-nmt/amun-regression-tests
 > git fetch --tags --progress http://github.com/marian-nmt/amun-regression-tests +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision be2dc2c2469301f8fb16ce6b60a5a7916ba961fb (refs/remotes/origin/master)
Commit message: "set max-length-multiple 3"
 > git config core.sparsecheckout # timeout=10
 > git checkout -f be2dc2c2469301f8fb16ce6b60a5a7916ba961fb
 > git rev-list be2dc2c2469301f8fb16ce6b60a5a7916ba961fb # timeout=10
[amun-regression-tests-gpu] $ /bin/sh -xe /tmp/jenkins5937896744514124920.sh
+ . /etc/environment
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
+ make model-ende
mkdir -p models
./scripts/download_models.py -m en-de -w models/model_en-de
Traceback (most recent call last):
  File "./scripts/download_models.py", line 7, in <module>
    import requests
ImportError: No module named requests
Makefile:39: recipe for target 'models/model_en-de' failed
make: *** [models/model_en-de] Error 1
Build step 'Execute shell' marked build as failure

[...truncated 1.49 KB...]
 > git rev-list 7fa9a5d62d6d1d6728a375b99645a2a36ebc41ff # timeout=10
[amun-regression-tests-cpu] $ /bin/sh -xe /tmp/jenkins6635465472712967772.sh
+ . /etc/environment
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
+ make model-ende
make: Nothing to be done for 'model-ende'.
+ make AMUN=../amun-cpu/build/amun test-cpu test-python
AMUN=../amun-cpu/build/amun bash -xe ./run_tests.sh tests/test_en_de_cpu tests/test_en_de_cpu_nbest
+ '[' 2 -eq 0 ']'
+ TESTS='tests/test_en_de_cpu tests/test_en_de_cpu_nbest'
+ AMUN_DEFAULT=../amun/build/amun
+ AMUN_PATH=../amun-cpu/build/amun
+ '[' '!' -s ../amun-cpu/build/amun ']'
++ realpath -q ../amun-cpu/build/amun
+ AMUN_REALPATH=/var/lib/jenkins/workspace/amun-cpu/build/amun
+ EXITCODE=0
++ ls -d tests/test_en_de_cpu tests/test_en_de_cpu_nbest
+ for test in '`ls -d $TESTS`'
+ cd tests/test_en_de_cpu
+ make -i AMUN=/var/lib/jenkins/workspace/amun-cpu/build/amun
make[1]: Entering directory '/var/lib/jenkins/workspace/amun-regression-tests-cpu/tests/test_en_de_cpu'
/var/lib/jenkins/workspace/amun-cpu/build/amun -c config.yml > test.out
../../scripts/diff.py -p 0.0001 test.out test.correct > test.diff
make[1]: Leaving directory '/var/lib/jenkins/workspace/amun-regression-tests-cpu/tests/test_en_de_cpu'
real 38.49
user 261.98
sys 5.88
+ grep -qi 'make.* error' err
+ cd -
/var/lib/jenkins/workspace/amun-regression-tests-cpu
+ for test in '`ls -d $TESTS`'
+ cd tests/test_en_de_cpu_nbest
+ make -i AMUN=/var/lib/jenkins/workspace/amun-cpu/build/amun
make[1]: Entering directory '/var/lib/jenkins/workspace/amun-regression-tests-cpu/tests/test_en_de_cpu_nbest'
/var/lib/jenkins/workspace/amun-cpu/build/amun -c config.yml > test.out
../../scripts/diff.py -p 0.002 test.out test.correct > test.diff
Makefile:7: recipe for target 'test' failed
make[1]: Leaving directory '/var/lib/jenkins/workspace/amun-regression-tests-cpu/tests/test_en_de_cpu_nbest'
real 31.89
user 401.81
sys 12.14
+ grep -qi 'make.* error' err
+ EXITCODE=1
+ cd -
/var/lib/jenkins/workspace/amun-regression-tests-cpu
+ exit 1
Makefile:16: recipe for target 'test-cpu' failed
make: *** [test-cpu] Error 1
Build step 'Execute shell' marked build as failure

GPU : 1080TI
OS : ubuntu 16.0.4

Amun repo's commit : 65d379b183265435f6945ae3ad8cb4cba28674bb (Date:   Fri Oct 5 09:40:53 2018 +0100)
Marian repo's commit (v1.6.0): b2a945c750a9daa2210fdd2198345cadd8628d24 (Date:   Sun Sep 16 12:05:32 2018 +0200)

Error Messages : 
[Fri Oct 12 14:08:56 2018] (I) Options: allow-unk: false
beam-size: 12
cpu-threads: 0
devices: [0, 1, 2]
gpu-threads: 1
log-info: info
log-progress: info
max-length: 500
max-length-multiple: 3
maxi-batch: 100
mini-batch: 10
mini-batch-words: 0
n-best: false
no-debpe: false
normalize: true
relative-paths: false
return-alignment: false
return-nematus-alignment: false
return-soft-alignment: false
scorers:
  F0:
    path: News_model-en-zh/model_revo_amun.npz.dev.npz
    type: Nematus
show-weights: false
softmax-filter:
  []
source-vocab: News_model-en-zh/vocab.en.yml
target-vocab: News_model-en-zh/vocab.zh.yml
tensor-cores: false
use-fused-softmax: true
weights:
  F0: 1
wipo: false

[Fri Oct 12 14:08:58 2018] (I) Loading scorers...
Error: Tensor not found:decoder_c_tt
Aborted (core dumped)

Started by upstream project "amun-cpu" build number 11
originally caused by:
 Started by GitHub push by hieuhoang
 Started by GitHub push by hieuhoang
Running as SYSTEM
Building remotely on var (vnni) in workspace /var/lib/jenkins/workspace/amun-regression-tests-cpu
Cloning the remote Git repository
Cloning repository http://github.com/marian-nmt/amun-regression-tests
 > git init /var/lib/jenkins/workspace/amun-regression-tests-cpu # timeout=10
Fetching upstream changes from http://github.com/marian-nmt/amun-regression-tests
 > git --version # timeout=10
 > git fetch --tags --progress http://github.com/marian-nmt/amun-regression-tests +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url http://github.com/marian-nmt/amun-regression-tests # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url http://github.com/marian-nmt/amun-regression-tests # timeout=10
Fetching upstream changes from http://github.com/marian-nmt/amun-regression-tests
 > git fetch --tags --progress http://github.com/marian-nmt/amun-regression-tests +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision be2dc2c2469301f8fb16ce6b60a5a7916ba961fb (refs/remotes/origin/master)
Commit message: "set max-length-multiple 3"
 > git config core.sparsecheckout # timeout=10
 > git checkout -f be2dc2c2469301f8fb16ce6b60a5a7916ba961fb
 > git rev-list be2dc2c2469301f8fb16ce6b60a5a7916ba961fb # timeout=10
[amun-regression-tests-cpu] $ /bin/sh -xe /tmp/jenkins5581363555134616097.sh
+ . /etc/environment
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
+ make model-ende
mkdir -p models
./scripts/download_models.py -m en-de -w models/model_en-de
Traceback (most recent call last):
  File "./scripts/download_models.py", line 7, in <module>
    import requests
ImportError: No module named requests
Makefile:39: recipe for target 'models/model_en-de' failed
make: *** [models/model_en-de] Error 1
Build step 'Execute shell' marked build as failure

Started by upstream project "amun-cpu" build number 8
originally caused by:
 Started by user Roman Grundkiewicz
Building on master in workspace /var/lib/jenkins/workspace/amun-regression-tests-cpu
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url http://github.com/marian-nmt/amun-regression-tests # timeout=10
Fetching upstream changes from http://github.com/marian-nmt/amun-regression-tests
 > git --version # timeout=10
 > git fetch --tags --progress http://github.com/marian-nmt/amun-regression-tests +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 7fa9a5d62d6d1d6728a375b99645a2a36ebc41ff (refs/remotes/origin/master)
Commit message: "Use bash -xe instead of bash -v"
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 7fa9a5d62d6d1d6728a375b99645a2a36ebc41ff
 > git rev-list 7fa9a5d62d6d1d6728a375b99645a2a36ebc41ff # timeout=10
[amun-regression-tests-cpu] $ /bin/sh -xe /tmp/jenkins6620768670270268715.sh
+ . /etc/environment
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
+ intentionally broken ...
/tmp/jenkins6620768670270268715.sh: 4: /tmp/jenkins6620768670270268715.sh: intentionally: not found
Build step 'Execute shell' marked build as failure

[...truncated 14.28 KB...]
build/src/amun/CMakeFiles/libcommon.dir/common/history.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/translation_task.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/loader.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/config.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/printer.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/utils.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/exception.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/types.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/filter.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/logging.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/processor/
build/src/amun/CMakeFiles/libcommon.dir/common/processor/bpe.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/factor_vocab.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/base_best_hyps.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/sentence.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/vocab.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/base_tensor.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/histories.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/god.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/scorer.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/sentences.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/search.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/common/output_collector.cpp.o
build/src/amun/CMakeFiles/libcommon.dir/DependInfo.cmake
build/src/amun/CMakeFiles/libcommon.dir/cmake_clean.cmake
build/src/amun/CMakeFiles/libcommon.dir/build.make
build/src/amun/CMakeFiles/CMakeDirectoryInformation.cmake
build/src/CMakeFiles/
build/src/CMakeFiles/progress.marks
build/src/CMakeFiles/CMakeDirectoryInformation.cmake
+ cd -
/var/lib/jenkins/workspace/amun-regression-tests-cpu
+ make model-ende
make: Nothing to be done for 'model-ende'.
+ CUDA_VISIBLE_DEVICES=0 bash run_tests.sh tests/test_en_de_cpu tests/test_en_de_cpu_nbest
../../../amun/build/amun -c config.yml > test.out
../../scripts/diff.py -p 0.0001 test.out test.correct > test.diff
real 37.52
user 255.35
sys 6.29
/var/lib/jenkins/workspace/amun-regression-tests-cpu
../../../amun/build/amun -c config.yml > test.out
../../scripts/diff.py -p 0.001 test.out test.correct > test.diff
Makefile:7: recipe for target 'test' failed
real 25.00
user 301.96
sys 10.92
/var/lib/jenkins/workspace/amun-regression-tests-cpu
Build step 'Execute shell' marked build as failure

[...truncated 1.69 KB...]
-- The CXX compiler identification is GNU 5.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Forcing compilation without CUDA.
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Boost version: 1.58.0
-- Found the following Boost libraries:
--   system
--   filesystem
--   program_options
--   timer
--   iostreams
--   python
--   thread
--   chrono
--   regex
--   date_time
--   atomic
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython2.7.so (found suitable version "2.7.12", minimum required is "2.7") 
-- Found Python
-- Found ZLIB: /usr/local/lib/libz.so (found version "1.2.8") 
-- Found Git: /usr/bin/git (found version "2.7.4") 
-- Git version: 65d379b
-- Found SparseHash: /usr/include  
-- Configuring done
-- Generating done
-- Build files have been written to: /var/lib/jenkins/workspace/amun-cpu/build
+ make -j4 intentionally broken!
make: *** No rule to make target 'intentionally'. Stop.
Build step 'Execute shell' marked build as failure
Archiving artifacts