Project

Profile

Help

Task #7262

run_test_matrix hangs

Added by Mark Zaslavskiy almost 5 years ago. Updated almost 5 years ago.

Status:
Closed
Priority:
Normal
Category:
mariadb testing
Sprint/Milestone:
Start date:
18.07.2016
Due date:
% Done:

0%

Estimated time:
2:00 h
Target branch:
Test scenario:

Description

13:29] 
timofey.turenko вообще этот матрикс завис и мне утром пришлось убить одну из подзадач. Тут похоже какой-то баг либо вагранта, либо шефа, либо либвирта.

[13:29] 
http://max-tst-01.mariadb.com:8089/view/test/job/run_test_matrix/backend=mariadb-10.1,box=centos_7_libvirt/11/console

[13:31] 
а письмо такое:

[13:31] 
run_test_matrix - Build # 11 - Aborted:

Check console output at http://max-tst-01.mariadb.com:8089/job/run_test_matrix/11/ to view the results.
Rebuild here: http://max-tst-01.mariadb.com:8089/job/run_test_matrix/11//rebuild

Result: $BUILD_LOG_PARSING_RESULT

Coredumps: $COREDUMPS

[13:32] 
то. есть у нас 8 отработавших тестов и один подвисший и убитый, но в отчете просто Aborted

[13:35] 
тут мысль есть про 1. таймауты в mdbci up ("если ничего не происходит больше чем, скажем, 20 минут, нет новых сторичек в логе - убивать задачу, убивать машины и может перезапускать") 2. убийстов задачи должно вести к убийству машин (если не стоит do_no_destroy_vm) и особождению vagrant_lock


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Task #7289: Add build timeout support to run_test build Closed21.07.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7290: Replace run_test_matrix build routines with run_test callClosed21.07.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7291: Modify http://max-tst-01.mariadb.com:8089/view/All/job/destroy jobClosed21.07.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by Mark Zaslavskiy almost 5 years ago

  • Estimated time set to 2:00 h

#2 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from New to Active / In progress

#3 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from Active / In progress to New

Solution:
- build hanging
-- setup build timeout (http://docs.openstack.org/infra/jenkins-job-builder/wrappers.html?highlight=timeout#wrappers.timeout). what type should be used ?
--- Absolute Abort build based on a fixed time-out.
--- No Activity Timeout when specified seconds has passed since the last log output.
- cleanup:
-- create clean_vms target (params: name + do_not_destroy)
-- call clean_vms with params inherited from build as a post-build action (http://docs.openstack.org/infra/jenkins-job-builder/publishers.html#publishers.trigger-parameterized-builds)

#4 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from New to Active / In progress

#5 Updated by Mark Zaslavskiy almost 5 years ago

  • Related to Task #7289: Add build timeout support to run_test build added

#6 Updated by Mark Zaslavskiy almost 5 years ago

  • Related to Task #7290: Replace run_test_matrix build routines with run_test call added

#7 Updated by Mark Zaslavskiy almost 5 years ago

  • Related to Task #7291: Modify http://max-tst-01.mariadb.com:8089/view/All/job/destroy job added

#8 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from Active / In progress to New

#9 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from New to Closed

Also available in: Atom PDF