Trace number 3385886

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3889.49 1300.13

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-14x38.cnf
MD5SUM56980124bab6f1dbe07ec523b7d59019
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2128
Number of clauses259616
Sum of the clauses size1032080
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23192
Number of clauses of size 30
Number of clauses of size 4256424
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385886-1305581332/watcher-3385886-1305581332 -o /tmp/evaluation-result-3385886-1305581332/solver-3385886-1305581332 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385886-1305581332.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.24 10.36 10.70 7/393 6601
/proc/meminfo: memFree=16889280/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=25660 CPUtime=0 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 878 0 0 0 0 0 0 0 25 0 1 0 669731110 26275840 699 33554432000 4194304 4625164 140734315607312 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/6601/statm: 6415 699 296 106 0 1918 0

[startup+0.032543 s]
/proc/loadavg: 10.24 10.36 10.70 7/393 6601
/proc/meminfo: memFree=16889280/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=29492 CPUtime=0.02 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3149 0 0 0 2 0 0 0 25 0 1 0 669731110 30199808 1790 33554432000 4194304 4625164 140734315607312 18446744073709551615 271550198469 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/6601/statm: 7373 1792 296 106 0 2876 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29492

[startup+0.10056 s]
/proc/loadavg: 10.24 10.36 10.70 7/393 6601
/proc/meminfo: memFree=16889280/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=40708 CPUtime=0.09 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 9537 0 0 0 9 0 0 0 25 0 1 0 669731110 41684992 4684 33554432000 4194304 4625164 140734315607312 18446744073709551615 4339865 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/6601/statm: 10177 4687 296 106 0 5680 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 40708

[startup+0.300458 s]
/proc/loadavg: 10.24 10.36 10.70 7/393 6601
/proc/meminfo: memFree=16889280/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=273532 CPUtime=0.54 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 28883 0 0 0 51 3 0 0 25 0 4 0 669731110 280096768 19769 33554432000 4194304 4625164 140734315607312 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 68383 19769 338 106 0 63886 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 273532

[startup+0.700384 s]
/proc/loadavg: 10.24 10.36 10.70 7/393 6601
/proc/meminfo: memFree=16889280/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=273532 CPUtime=1.74 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 39032 0 0 0 170 4 0 0 25 0 4 0 669731110 280096768 20662 33554432000 4194304 4625164 140734315607312 18446744073709551615 4519414 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 68383 20662 338 106 0 63886 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 273532

[startup+1.50024 s]
/proc/loadavg: 10.22 10.35 10.69 11/397 6605
/proc/meminfo: memFree=16804316/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=277296 CPUtime=4.13 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 60522 0 0 0 407 6 0 0 25 0 4 0 669731110 283951104 22788 33554432000 4194304 4625164 140734315607312 18446744073709551615 4280393 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 69324 22788 339 106 0 64827 0
[pid=6601/tid=6603] ppid=6599 vsize=277296 CPUtime=0.71 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 1500 0 0 0 71 0 0 0 25 0 4 0 669731127 283951104 22788 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=277296 CPUtime=0.6 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 3394 0 0 0 60 0 0 0 25 0 4 0 669731127 283951104 22788 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=277296 CPUtime=1.3 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 33441 0 0 0 128 2 0 0 25 0 4 0 669731127 283951104 22788 33554432000 4194304 4625164 140734315607312 18446744073709551615 4334473 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.13
Current children cumulated vsize (KiB) 277296

[startup+3.10095 s]
/proc/loadavg: 10.22 10.35 10.69 11/397 6605
/proc/meminfo: memFree=16792532/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=287108 CPUtime=8.91 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 107022 0 0 0 880 11 0 0 25 0 4 0 669731110 293998592 26512 33554432000 4194304 4625164 140734315607312 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 71777 26512 339 106 0 67280 0
[pid=6601/tid=6603] ppid=6599 vsize=287108 CPUtime=1.5 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 3994 0 0 0 150 0 0 0 25 0 4 0 669731127 293998592 26512 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=287108 CPUtime=1.4 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 4069 0 0 0 140 0 0 0 25 0 4 0 669731127 293998592 26512 33554432000 4194304 4625164 140734315607312 18446744073709551615 4464266 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=287108 CPUtime=2.89 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 74757 0 0 0 282 7 0 0 25 0 4 0 669731127 293998592 26512 33554432000 4194304 4625164 140734315607312 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.91
Current children cumulated vsize (KiB) 287108

[startup+6.30037 s]
/proc/loadavg: 10.20 10.35 10.69 11/397 6605
/proc/meminfo: memFree=16751172/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=307104 CPUtime=18.47 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 147480 0 0 0 1830 17 0 0 25 0 4 0 669731110 314474496 36485 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396763 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 76776 36485 341 106 0 72279 0
[pid=6601/tid=6603] ppid=6599 vsize=307104 CPUtime=3.81 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 6142 0 0 0 380 1 0 0 25 0 4 0 669731127 314474496 36485 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=307104 CPUtime=3.26 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 5757 0 0 0 326 0 0 0 25 0 4 0 669731127 314474496 36485 33554432000 4194304 4625164 140734315607312 18446744073709551615 4464215 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=307104 CPUtime=5.08 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 110882 0 0 0 496 12 0 0 25 0 4 0 669731127 314474496 36485 33554432000 4194304 4625164 140734315607312 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.47
Current children cumulated vsize (KiB) 307104

[startup+12.7002 s]
/proc/loadavg: 10.18 10.34 10.69 11/397 6605
/proc/meminfo: memFree=16674668/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=396020 CPUtime=37.58 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 249833 0 0 0 3725 33 0 0 25 0 4 0 669731110 405524480 54570 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 99005 54570 342 106 0 94508 0
[pid=6601/tid=6603] ppid=6599 vsize=396020 CPUtime=7.5 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 10973 0 0 0 748 2 0 0 25 0 4 0 669731127 405524480 54570 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=396020 CPUtime=7 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 12280 0 0 0 698 2 0 0 25 0 4 0 669731127 405524480 54570 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=396020 CPUtime=10.76 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 197707 0 0 0 1052 24 0 0 25 0 4 0 669731127 405524480 54570 33554432000 4194304 4625164 140734315607312 18446744073709551615 4546583 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37.58
Current children cumulated vsize (KiB) 396020

[startup+25.5009 s]
/proc/loadavg: 10.23 10.35 10.68 11/397 6696
/proc/meminfo: memFree=17543696/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=459024 CPUtime=81.54 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 423702 0 0 0 8098 56 0 0 25 0 4 0 669731110 470040576 84761 33554432000 4194304 4625164 140734315607312 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 114756 84761 342 106 0 110259 0
[pid=6601/tid=6603] ppid=6599 vsize=459024 CPUtime=18.37 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 18418 0 0 0 1834 3 0 0 25 0 4 0 669731127 470040576 84762 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352776 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=459024 CPUtime=15.22 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 20357 0 0 0 1519 3 0 0 25 0 4 0 669731127 470040576 84762 33554432000 4194304 4625164 140734315607312 18446744073709551615 271550198817 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=459024 CPUtime=22.82 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 352012 0 0 0 2238 44 0 0 25 0 4 0 669731127 470040576 84762 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 81.54
Current children cumulated vsize (KiB) 459024

[startup+51.1003 s]
/proc/loadavg: 10.21 10.33 10.67 11/397 6757
/proc/meminfo: memFree=17167668/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=661788 CPUtime=158.97 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 738469 0 0 0 15793 104 0 0 25 0 4 0 669731110 677670912 125206 33554432000 4194304 4625164 140734315607312 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 165447 125206 342 106 0 160950 0
[pid=6601/tid=6603] ppid=6599 vsize=661788 CPUtime=41.66 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 33543 0 0 0 4158 8 0 0 25 0 4 0 669731127 677670912 125206 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=661788 CPUtime=28.65 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 32736 0 0 0 2855 10 0 0 25 0 4 0 669731127 677670912 125206 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=661788 CPUtime=40.28 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 629298 0 0 0 3949 79 0 0 25 0 4 0 669731127 677670912 125206 33554432000 4194304 4625164 140734315607312 18446744073709551615 4547368 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 158.97
Current children cumulated vsize (KiB) 661788

[startup+102.315 s]
/proc/loadavg: 10.34 10.34 10.65 11/397 6758
/proc/meminfo: memFree=16730528/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=997568 CPUtime=311.94 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 1168547 0 0 0 31022 172 0 0 25 0 4 0 669731110 1021509632 200348 33554432000 4194304 4625164 140734315607312 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 249392 200348 814 106 0 244895 0
[pid=6601/tid=6603] ppid=6599 vsize=997568 CPUtime=81.59 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 52659 0 0 0 8146 13 0 0 25 0 4 0 669731127 1021509632 200348 33554432000 4194304 4625164 140734315607312 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=997568 CPUtime=62.77 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 64702 0 0 0 6254 23 0 0 25 0 4 0 669731127 1021509632 200348 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=997568 CPUtime=68.24 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 997427 0 0 0 6697 127 0 0 25 0 4 0 669731127 1021509632 200348 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 311.94
Current children cumulated vsize (KiB) 997568

[startup+162.301 s]
/proc/loadavg: 10.17 10.29 10.61 11/397 6760
/proc/meminfo: memFree=16281636/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=1287788 CPUtime=491.09 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 1603212 0 0 0 48871 238 0 0 25 0 4 0 669731110 1318694912 272390 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396536 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 321947 272390 831 106 0 317450 0
[pid=6601/tid=6603] ppid=6599 vsize=1287788 CPUtime=128.52 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 78004 0 0 0 12832 20 0 0 25 0 4 0 669731127 1318694912 272390 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=1287788 CPUtime=105.68 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 99759 0 0 0 10532 36 0 0 25 0 4 0 669731127 1318694912 272390 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=1287788 CPUtime=97.62 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 1364760 0 0 0 9590 172 0 0 25 0 4 0 669731127 1318694912 272390 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 491.09
Current children cumulated vsize (KiB) 1287788

[startup+222.3 s]
/proc/loadavg: 10.25 10.29 10.59 11/397 6761
/proc/meminfo: memFree=15976084/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=1469720 CPUtime=670.31 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 2043208 0 0 0 66728 303 0 0 25 0 4 0 669731110 1504993280 317455 33554432000 4194304 4625164 140734315607312 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 367430 317455 813 106 0 362933 0
[pid=6601/tid=6603] ppid=6599 vsize=1469720 CPUtime=187.75 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 87932 0 0 0 18753 22 0 0 25 0 4 0 669731127 1504993280 317455 33554432000 4194304 4625164 140734315607312 18446744073709551615 4339660 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=1469720 CPUtime=135.68 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 111970 0 0 0 13521 47 0 0 25 0 4 0 669731127 1504993280 317455 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=1469720 CPUtime=132.09 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 1770335 0 0 0 12986 223 0 0 25 0 4 0 669731127 1504993280 317455 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 670.31
Current children cumulated vsize (KiB) 1469720

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2103.77
Current children cumulated vsize (KiB) 2415144

[startup+762.315 s]
/proc/loadavg: 10.12 10.18 10.39 11/397 6776
/proc/meminfo: memFree=14263828/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2459804 CPUtime=2283.05 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3056405 0 0 0 227815 490 0 0 25 0 4 0 669731110 2518839296 537508 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 614951 537508 398 106 0 610454 0
[pid=6601/tid=6603] ppid=6599 vsize=2459804 CPUtime=522.98 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 254340 0 0 0 52237 61 0 0 25 0 4 0 669731127 2518839296 537508 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2459804 CPUtime=606.83 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147393 0 0 0 60615 68 0 0 25 0 4 0 669731127 2518839296 537508 33554432000 4194304 4625164 140734315607312 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2459804 CPUtime=406.73 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2533952 0 0 0 40331 342 0 0 25 0 4 0 669731127 2518839296 537508 33554432000 4194304 4625164 140734315607312 18446744073709551615 4579343 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2283.05
Current children cumulated vsize (KiB) 2459804

[startup+822.301 s]
/proc/loadavg: 10.22 10.19 10.38 11/397 6777
/proc/meminfo: memFree=14120708/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2529048 CPUtime=2462.26 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3074580 0 0 0 245729 497 0 0 25 0 4 0 669731110 2589745152 555585 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 632262 555585 405 106 0 627765 0
[pid=6601/tid=6603] ppid=6599 vsize=2529048 CPUtime=552.97 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 256116 0 0 0 55235 62 0 0 25 0 4 0 669731127 2589745152 555585 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2529048 CPUtime=666.06 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147451 0 0 0 66538 68 0 0 25 0 4 0 669731127 2589745152 555585 33554432000 4194304 4625164 140734315607312 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2529048 CPUtime=436.73 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2549268 0 0 0 43327 346 0 0 25 0 4 0 669731127 2589745152 555585 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2462.26
Current children cumulated vsize (KiB) 2529048

[startup+882.301 s]
/proc/loadavg: 10.15 10.17 10.35 11/397 6779
/proc/meminfo: memFree=14011824/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2576792 CPUtime=2641.5 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3088774 0 0 0 263647 503 0 0 25 0 4 0 669731110 2638635008 569647 33554432000 4194304 4625164 140734315607312 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 644198 569647 405 106 0 639701 0
[pid=6601/tid=6603] ppid=6599 vsize=2576792 CPUtime=582.99 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 257400 0 0 0 58236 63 0 0 25 0 4 0 669731127 2638635008 569647 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2576792 CPUtime=725.29 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147506 0 0 0 72461 68 0 0 25 0 4 0 669731127 2638635008 569647 33554432000 4194304 4625164 140734315607312 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2576792 CPUtime=466.73 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2561245 0 0 0 46322 351 0 0 25 0 4 0 669731127 2638635008 569647 33554432000 4194304 4625164 140734315607312 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2641.5
Current children cumulated vsize (KiB) 2576792

[startup+942.301 s]
/proc/loadavg: 10.18 10.17 10.34 11/397 6781
/proc/meminfo: memFree=13943472/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2622284 CPUtime=2820.74 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3101305 0 0 0 281568 506 0 0 25 0 4 0 669731110 2685218816 582066 33554432000 4194304 4625164 140734315607312 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 655571 582066 403 106 0 651074 0
[pid=6601/tid=6603] ppid=6599 vsize=2622284 CPUtime=612.99 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 257557 0 0 0 61236 63 0 0 25 0 4 0 669731127 2685218816 582066 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2622284 CPUtime=784.54 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147563 0 0 0 78386 68 0 0 25 0 4 0 669731127 2685218816 582066 33554432000 4194304 4625164 140734315607312 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2622284 CPUtime=496.72 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2572602 0 0 0 49318 354 0 0 25 0 4 0 669731127 2685218816 582066 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2820.74
Current children cumulated vsize (KiB) 2622284

[startup+1002.3 s]
/proc/loadavg: 10.13 10.15 10.32 11/397 6782
/proc/meminfo: memFree=13862848/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2665392 CPUtime=2999.98 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3115188 0 0 0 299483 515 0 0 25 0 4 0 669731110 2729361408 595802 33554432000 4194304 4625164 140734315607312 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 666348 595802 398 106 0 661851 0
[pid=6601/tid=6603] ppid=6599 vsize=2665392 CPUtime=643.01 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 259519 0 0 0 64234 67 0 0 25 0 4 0 669731127 2729361408 595802 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2665392 CPUtime=843.77 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147613 0 0 0 84309 68 0 0 25 0 4 0 669731127 2729361408 595802 33554432000 4194304 4625164 140734315607312 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2665392 CPUtime=526.7 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2583409 0 0 0 52312 358 0 0 25 0 4 0 669731127 2729361408 595802 33554432000 4194304 4625164 140734315607312 18446744073709551615 4552340 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2999.98
Current children cumulated vsize (KiB) 2665392

[startup+1062.3 s]
/proc/loadavg: 10.21 10.17 10.32 11/397 6784
/proc/meminfo: memFree=13784092/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2706832 CPUtime=3179.23 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3129462 0 0 0 317401 522 0 0 25 0 4 0 669731110 2771795968 609934 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 676708 609934 398 106 0 672211 0
[pid=6601/tid=6603] ppid=6599 vsize=2706832 CPUtime=673.1 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 262455 0 0 0 67242 68 0 0 25 0 4 0 669731127 2771795968 609934 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2706832 CPUtime=903.01 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147655 0 0 0 90233 68 0 0 25 0 4 0 669731127 2771795968 609934 33554432000 4194304 4625164 140734315607312 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2706832 CPUtime=556.61 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2593811 0 0 0 55298 363 0 0 25 0 4 0 669731127 2771795968 609934 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3179.23
Current children cumulated vsize (KiB) 2706832

[startup+1122.3 s]
/proc/loadavg: 10.18 10.16 10.30 11/397 6785
/proc/meminfo: memFree=13670988/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2746348 CPUtime=3358.47 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3145058 0 0 0 335316 531 0 0 25 0 4 0 669731110 2812260352 625366 33554432000 4194304 4625164 140734315607312 18446744073709551615 4396511 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 686587 625366 398 106 0 682090 0
[pid=6601/tid=6603] ppid=6599 vsize=2746348 CPUtime=703.1 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 266560 0 0 0 70238 72 0 0 25 0 4 0 669731127 2812260352 625366 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2746348 CPUtime=962.25 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147711 0 0 0 96157 68 0 0 25 0 4 0 669731127 2812260352 625366 33554432000 4194304 4625164 140734315607312 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2746348 CPUtime=586.61 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2603868 0 0 0 58294 367 0 0 25 0 4 0 669731127 2812260352 625366 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3358.47
Current children cumulated vsize (KiB) 2746348

[startup+1182.3 s]
/proc/loadavg: 10.27 10.19 10.30 11/397 6787
/proc/meminfo: memFree=13569176/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2791500 CPUtime=3537.71 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3159088 0 0 0 353234 537 0 0 25 0 4 0 669731110 2858496000 639244 33554432000 4194304 4625164 140734315607312 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 697875 639244 398 106 0 693378 0
[pid=6601/tid=6603] ppid=6599 vsize=2791500 CPUtime=733.09 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 268481 0 0 0 73235 74 0 0 25 0 4 0 669731127 2858496000 639244 33554432000 4194304 4625164 140734315607312 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2791500 CPUtime=1021.49 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147760 0 0 0 102081 68 0 0 25 0 4 0 669731127 2858496000 639244 33554432000 4194304 4625164 140734315607312 18446744073709551615 4330793 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2791500 CPUtime=616.63 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2614941 0 0 0 61293 370 0 0 25 0 4 0 669731127 2858496000 639244 33554432000 4194304 4625164 140734315607312 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3537.71
Current children cumulated vsize (KiB) 2791500

[startup+1242.3 s]
/proc/loadavg: 10.14 10.17 10.28 11/397 6789
/proc/meminfo: memFree=13395804/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2909456 CPUtime=3716.94 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3205387 0 0 0 371147 547 0 0 25 0 4 0 669731110 2979282944 664415 33554432000 4194304 4625164 140734315607312 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6601/statm: 727364 664415 398 106 0 722867 0
[pid=6601/tid=6603] ppid=6599 vsize=2909456 CPUtime=763.09 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 271472 0 0 0 76231 78 0 0 25 0 4 0 669731127 2979282944 664415 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2909456 CPUtime=1080.72 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147842 0 0 0 108004 68 0 0 25 0 4 0 669731127 2979282944 664415 33554432000 4194304 4625164 140734315607312 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2909456 CPUtime=672.36 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2633953 0 0 0 66863 373 0 0 25 0 4 0 669731127 2979282944 664415 33554432000 4194304 4625164 140734315607312 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3716.94
Current children cumulated vsize (KiB) 2909456



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.24 10.19 10.28 11/397 6790
/proc/meminfo: memFree=13301552/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=2992444 CPUtime=3889.34 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) R 6599 6601 5970 0 -1 4202496 3427519 0 0 0 388353 581 0 0 25 0 4 0 669731110 3064262656 684429 33554432000 4194304 4625164 140734315607312 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 748111 684429 399 106 0 743614 0
[pid=6601/tid=6603] ppid=6599 vsize=2992444 CPUtime=798.26 cores=0,2,4,6
/proc/6601/task/6603/stat : 6603 (SArTagnan) R 6599 6601 5970 0 -1 4202560 272859 0 0 0 79747 79 0 0 25 0 4 0 669731127 3064262656 684982 33554432000 4194304 4625164 140734315607312 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6601/tid=6604] ppid=6599 vsize=2992444 CPUtime=1137.7 cores=0,2,4,6
/proc/6601/task/6604/stat : 6604 (SArTagnan) R 6599 6601 5970 0 -1 4202560 147919 0 0 0 113702 68 0 0 25 0 4 0 669731127 3064262656 684982 33554432000 4194304 4625164 140734315607312 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6601/tid=6605] ppid=6599 vsize=2992444 CPUtime=723.78 cores=0,2,4,6
/proc/6601/task/6605/stat : 6605 (SArTagnan) R 6599 6601 5970 0 -1 4202560 2853271 0 0 0 71972 406 0 0 25 0 4 0 669731127 3064262656 684982 33554432000 4194304 4625164 140734315607312 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3889.34
Current children cumulated vsize (KiB) 2992444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 10.38 10.22 10.29 8/396 6791
/proc/meminfo: memFree=15710136/32951124 swapFree=67056796/67111528
[pid=6601] ppid=6599 vsize=0 CPUtime=3889.47 cores=0,2,4,6
/proc/6601/stat : 6601 (SArTagnan) Z 6599 6601 5970 0 -1 4203548 3428118 0 0 0 388355 592 0 0 25 0 2 0 669731110 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6601/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 3889.47
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.13
CPU time (s): 3889.49
CPU user time (s): 3883.56
CPU system time (s): 5.9291
CPU usage (%): 299.161
Max. virtual memory (cumulated for all children) (KiB): 2992444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3883.56
system time used= 5.9291
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3428118
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6469
involuntary context switches= 87449

runsolver used 4.66829 second user time and 11.9052 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-16 23:28:52
IDJOB=3385886
IDBENCH=83180
IDSOLVER=1871
FILE ID=node133/3385886-1305581332
RUNJOBID= node133-1305576779-5988
PBS_JOBID= 13350209
Free space on /tmp= 73392 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-14x38.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385886-1305581332/watcher-3385886-1305581332 -o /tmp/evaluation-result-3385886-1305581332/solver-3385886-1305581332 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385886-1305581332.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 56980124bab6f1dbe07ec523b7d59019
RANDOM SEED=245649711

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16889312 kB
Buffers:        301288 kB
Cached:        4178496 kB
SwapCached:       7668 kB
Active:       12848068 kB
Inactive:      2904932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16889312 kB
SwapTotal:    67111528 kB
SwapFree:     67056796 kB
Dirty:            6636 kB
Writeback:           0 kB
AnonPages:    11271204 kB
Mapped:          32732 kB
Slab:           197004 kB
PageTables:      46468 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 85967872 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73392 MiB
End job on node133 at 2011-05-16 23:50:34