Trace number 3385878

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3898.9 1300.11

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x40.cnf
MD5SUM3a7a68cedc6ab84c0df9c27d166b0b6b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of clauses48480
Sum of the clauses size191040
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21440
Number of clauses of size 30
Number of clauses of size 447040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385878-1305581320/watcher-3385878-1305581320 -o /tmp/evaluation-result-3385878-1305581320/solver-3385878-1305581320 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385878-1305581320.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.90 10.17 10.08 8/348 6143
/proc/meminfo: memFree=15792528/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=20460 CPUtime=0 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 775 0 0 0 0 0 0 0 25 0 1 0 669730162 20951040 633 33554432000 4194304 4625164 140736678575184 18446744073709551615 246516834048 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6143/statm: 5115 633 296 106 0 618 0

[startup+0.0218549 s]
/proc/loadavg: 9.90 10.17 10.08 8/348 6143
/proc/meminfo: memFree=15792528/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=23052 CPUtime=0.01 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 2147 0 0 0 1 0 0 0 25 0 1 0 669730162 23605248 1265 33554432000 4194304 4625164 140736678575184 18446744073709551615 4361412 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6143/statm: 5763 1281 296 106 0 1266 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 23052

[startup+0.478727 s]
/proc/loadavg: 9.90 10.17 10.08 8/348 6143
/proc/meminfo: memFree=15792528/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=204232 CPUtime=1.36 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 10453 0 0 0 135 1 0 0 25 0 4 0 669730162 209133568 6594 33554432000 4194304 4625164 140736678575184 18446744073709551615 4393263 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 51058 6594 340 106 0 46561 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 204232

[startup+0.533594 s]
/proc/loadavg: 9.90 10.17 10.08 8/348 6143
/proc/meminfo: memFree=15792528/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=202708 CPUtime=1.52 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) D 6141 6143 5768 0 -1 4202496 10866 0 0 0 151 1 0 0 25 0 4 0 669730162 207572992 6399 33554432000 4194304 4625164 140736678575184 18446744073709551615 246516877402 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 50677 6399 340 106 0 46180 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 202708

[startup+0.700703 s]
/proc/loadavg: 9.90 10.17 10.08 8/348 6143
/proc/meminfo: memFree=15792528/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=267632 CPUtime=2.01 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 12152 0 0 0 200 1 0 0 25 0 4 0 669730162 274055168 7250 33554432000 4194304 4625164 140736678575184 18446744073709551615 4338046 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 66908 7250 340 106 0 62411 0
Current children cumulated CPU time (s) 2.01
Current children cumulated vsize (KiB) 267632

[startup+1.50056 s]
/proc/loadavg: 9.90 10.17 10.08 11/352 6147
/proc/meminfo: memFree=15749392/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=272352 CPUtime=4.4 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 21422 0 0 0 437 3 0 0 25 0 4 0 669730162 278888448 12247 33554432000 4194304 4625164 140736678575184 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 68088 12247 342 106 0 63591 0
[pid=6143/tid=6145] ppid=6141 vsize=272352 CPUtime=0.73 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 2508 0 0 0 73 0 0 0 25 0 4 0 669730165 278888448 12247 33554432000 4194304 4625164 140736678575184 18446744073709551615 4353019 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=272352 CPUtime=1.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3420 0 0 0 115 0 0 0 19 0 4 0 669730165 278888448 12247 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=272352 CPUtime=1.01 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 8776 0 0 0 100 1 0 0 25 0 4 0 669730165 278888448 12247 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552385 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.4
Current children cumulated vsize (KiB) 272352

[startup+3.10027 s]
/proc/loadavg: 9.90 10.17 10.08 11/352 6147
/proc/meminfo: memFree=15725348/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=276372 CPUtime=9.19 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 40310 0 0 0 913 6 0 0 25 0 4 0 669730162 283004928 19563 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 69093 19563 342 106 0 64596 0
[pid=6143/tid=6145] ppid=6141 vsize=276372 CPUtime=1.43 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 4336 0 0 0 143 0 0 0 25 0 4 0 669730165 283004928 19563 33554432000 4194304 4625164 140736678575184 18446744073709551615 4339660 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=276372 CPUtime=2.05 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 6240 0 0 0 204 1 0 0 21 0 4 0 669730165 283004928 19563 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=276372 CPUtime=2.59 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 21198 0 0 0 257 2 0 0 25 0 4 0 669730165 283004928 19563 33554432000 4194304 4625164 140736678575184 18446744073709551615 246516501462 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.19
Current children cumulated vsize (KiB) 276372

[startup+6.30068 s]
/proc/loadavg: 9.91 10.17 10.08 11/352 6147
/proc/meminfo: memFree=15665152/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=289824 CPUtime=18.74 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 83966 0 0 0 1860 14 0 0 25 0 4 0 669730162 296779776 32347 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396493 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 72456 32347 342 106 0 67959 0
[pid=6143/tid=6145] ppid=6141 vsize=289824 CPUtime=2.82 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 7569 0 0 0 281 1 0 0 25 0 4 0 669730165 296779776 32347 33554432000 4194304 4625164 140736678575184 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=289824 CPUtime=4.09 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 10874 0 0 0 406 3 0 0 19 0 4 0 669730165 296779776 32347 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=289824 CPUtime=5.52 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 55162 0 0 0 544 8 0 0 25 0 4 0 669730165 296779776 32347 33554432000 4194304 4625164 140736678575184 18446744073709551615 4547307 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 18.74
Current children cumulated vsize (KiB) 289824

[startup+12.7005 s]
/proc/loadavg: 9.92 10.16 10.08 11/352 6148
/proc/meminfo: memFree=15576248/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=374148 CPUtime=37.84 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 145860 0 0 0 3758 26 0 0 19 0 4 0 669730162 383127552 53719 33554432000 4194304 4625164 140736678575184 18446744073709551615 4511747 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 93537 53719 342 106 0 89040 0
[pid=6143/tid=6145] ppid=6141 vsize=374148 CPUtime=7.03 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 12640 0 0 0 700 3 0 0 19 0 4 0 669730165 383127552 53719 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=374148 CPUtime=6.92 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 16784 0 0 0 688 4 0 0 25 0 4 0 669730165 383127552 53719 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=374148 CPUtime=11.53 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 102006 0 0 0 1138 15 0 0 19 0 4 0 669730165 383127552 53719 33554432000 4194304 4625164 140736678575184 18446744073709551615 4327800 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37.84
Current children cumulated vsize (KiB) 374148

[startup+25.5012 s]
/proc/loadavg: 9.94 10.16 10.08 11/352 6148
/proc/meminfo: memFree=15442712/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=478228 CPUtime=76.1 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 236395 0 0 0 7569 41 0 0 25 0 4 0 669730162 489705472 84273 33554432000 4194304 4625164 140736678575184 18446744073709551615 4338083 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 119557 84273 342 106 0 115060 0
[pid=6143/tid=6145] ppid=6141 vsize=478228 CPUtime=16.69 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 19531 0 0 0 1664 5 0 0 25 0 4 0 669730165 489705472 84281 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=478228 CPUtime=13.84 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 25740 0 0 0 1377 7 0 0 20 0 4 0 669730165 489705472 84281 33554432000 4194304 4625164 140736678575184 18446744073709551615 246516495393 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=478228 CPUtime=20.7 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 170531 0 0 0 2045 25 0 0 25 0 4 0 669730165 489705472 84281 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 76.1
Current children cumulated vsize (KiB) 478228

[startup+51.1005 s]
/proc/loadavg: 9.96 10.14 10.07 11/352 6149
/proc/meminfo: memFree=15233372/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=647268 CPUtime=154.18 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 374238 0 0 0 15341 77 0 0 25 0 4 0 669730162 662802432 127969 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 161817 127969 342 106 0 157320 0
[pid=6143/tid=6145] ppid=6141 vsize=647268 CPUtime=37.82 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 31137 0 0 0 3771 11 0 0 21 0 4 0 669730165 662802432 127969 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=647268 CPUtime=33.01 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 46967 0 0 0 3279 22 0 0 25 0 4 0 669730165 662802432 127969 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=647268 CPUtime=32.88 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 267067 0 0 0 3250 38 0 0 25 0 4 0 669730165 662802432 127969 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 154.18
Current children cumulated vsize (KiB) 647268

[startup+102.301 s]
/proc/loadavg: 10.07 10.15 10.08 11/352 6150
/proc/meminfo: memFree=14951236/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=921280 CPUtime=306.9 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 619019 0 0 0 30550 140 0 0 25 0 4 0 669730162 943390720 192477 33554432000 4194304 4625164 140736678575184 18446744073709551615 4360575 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/6143/statm: 230320 192477 358 106 0 225823 0
[pid=6143/tid=6145] ppid=6141 vsize=921280 CPUtime=82.57 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 62677 0 0 0 8235 22 0 0 25 0 4 0 669730165 943390720 192477 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=921280 CPUtime=64.73 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 72593 0 0 0 6425 48 0 0 18 0 4 0 669730165 943390720 192477 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=921280 CPUtime=58.31 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 442394 0 0 0 5768 63 0 0 25 0 4 0 669730165 943390720 192477 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 306.9
Current children cumulated vsize (KiB) 921280

[startup+162.3 s]
/proc/loadavg: 10.10 10.15 10.08 12/352 6213
/proc/meminfo: memFree=15534200/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=1219484 CPUtime=486.29 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 875641 0 0 0 48437 192 0 0 25 0 4 0 669730162 1248751616 252416 33554432000 4194304 4625164 140736678575184 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6143/statm: 304871 252416 342 106 0 300374 0
[pid=6143/tid=6145] ppid=6141 vsize=1219484 CPUtime=122.6 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 86782 0 0 0 12231 29 0 0 25 0 4 0 669730165 1248751616 252416 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=1219484 CPUtime=100.59 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 97980 0 0 0 9996 63 0 0 25 0 4 0 669730165 1248751616 252416 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=1219484 CPUtime=106.25 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 645720 0 0 0 10533 92 0 0 25 0 4 0 669730165 1248751616 252416 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552296 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 486.29
Current children cumulated vsize (KiB) 1219484

[startup+222.3 s]
/proc/loadavg: 10.07 10.13 10.08 12/352 6214
/proc/meminfo: memFree=15181640/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=1504684 CPUtime=666.62 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 1085414 0 0 0 66421 241 0 0 25 0 4 0 669730162 1540796416 309860 33554432000 4194304 4625164 140736678575184 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 376171 309860 342 106 0 371674 0
[pid=6143/tid=6145] ppid=6141 vsize=1504684 CPUtime=159.03 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 118589 0 0 0 15864 39 0 0 25 0 4 0 669730165 1540796416 309860 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=1504684 CPUtime=142.74 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 117025 0 0 0 14195 79 0 0 25 0 4 0 669730165 1540796416 309860 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=1504684 CPUtime=151.18 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 787470 0 0 0 15005 113 0 0 25 0 4 0 669730165 1540796416 309860 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 666.62
Current children cumulated vsize (KiB) 1504684

[startup+282.3 s]

################
# More data... #
################

[pid=6143] ppid=6141 vsize=2264044 CPUtime=2285.6 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 2953500 0 0 0 227965 595 0 0 25 0 4 0 669730162 2318381056 496549 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396550 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 566011 496549 359 106 0 561514 0
[pid=6143/tid=6145] ppid=6141 vsize=2264044 CPUtime=479.06 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 194033 0 0 0 47827 79 0 0 25 0 4 0 669730165 2318381056 496549 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2264044 CPUtime=626.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154480 0 0 0 62509 106 0 0 25 0 4 0 669730165 2318381056 496549 33554432000 4194304 4625164 140736678575184 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2264044 CPUtime=438.12 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 2509508 0 0 0 43419 393 0 0 25 0 4 0 669730165 2318381056 496549 33554432000 4194304 4625164 140736678575184 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2285.6
Current children cumulated vsize (KiB) 2264044

[startup+822.301 s]
/proc/loadavg: 10.22 10.19 10.11 12/352 6230
/proc/meminfo: memFree=13437280/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2264176 CPUtime=2465.6 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 3174446 0 0 0 245923 637 0 0 25 0 4 0 669730162 2318516224 507613 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 566044 507613 357 106 0 561547 0
[pid=6143/tid=6145] ppid=6141 vsize=2264176 CPUtime=509.05 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 196216 0 0 0 50824 81 0 0 25 0 4 0 669730165 2318516224 507613 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2264176 CPUtime=686.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154589 0 0 0 68509 106 0 0 25 0 4 0 669730165 2318516224 507613 33554432000 4194304 4625164 140736678575184 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2264176 CPUtime=468.13 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 2726971 0 0 0 46380 433 0 0 25 0 4 0 669730165 2318516224 507613 33554432000 4194304 4625164 140736678575184 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2465.6
Current children cumulated vsize (KiB) 2264176

[startup+882.301 s]
/proc/loadavg: 10.22 10.19 10.12 11/352 6232
/proc/meminfo: memFree=13371288/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2329844 CPUtime=2645.6 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 3392672 0 0 0 263886 674 0 0 25 0 4 0 669730162 2385760256 519370 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 582461 519370 360 106 0 577964 0
[pid=6143/tid=6145] ppid=6141 vsize=2329844 CPUtime=539.06 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 198813 0 0 0 53822 84 0 0 25 0 4 0 669730165 2385760256 519370 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2329844 CPUtime=746.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154658 0 0 0 74509 106 0 0 25 0 4 0 669730165 2385760256 519370 33554432000 4194304 4625164 140736678575184 18446744073709551615 4330866 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2329844 CPUtime=498.13 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 2941820 0 0 0 49345 468 0 0 25 0 4 0 669730165 2385760256 519370 33554432000 4194304 4625164 140736678575184 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2645.6
Current children cumulated vsize (KiB) 2329844

[startup+942.301 s]
/proc/loadavg: 10.29 10.23 10.13 11/352 6233
/proc/meminfo: memFree=13293384/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2395512 CPUtime=2825.6 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 3638195 0 0 0 281842 718 0 0 25 0 4 0 669730162 2453004288 532276 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 598878 532276 362 106 0 594381 0
[pid=6143/tid=6145] ppid=6141 vsize=2395512 CPUtime=569.1 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 202699 0 0 0 56823 87 0 0 25 0 4 0 669730165 2453004288 532276 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2395512 CPUtime=806.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154719 0 0 0 80509 106 0 0 25 0 4 0 669730165 2453004288 532276 33554432000 4194304 4625164 140736678575184 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2395512 CPUtime=529.92 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3182591 0 0 0 52483 509 0 0 25 0 4 0 669730165 2453004288 532276 33554432000 4194304 4625164 140736678575184 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2825.6
Current children cumulated vsize (KiB) 2395512

[startup+1002.3 s]
/proc/loadavg: 10.15 10.20 10.13 11/352 6235
/proc/meminfo: memFree=13181500/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2461180 CPUtime=3005.63 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 3871708 0 0 0 299801 762 0 0 25 0 4 0 669730162 2520248320 548287 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 615295 548287 382 106 0 610798 0
[pid=6143/tid=6145] ppid=6141 vsize=2461180 CPUtime=599.12 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 206467 0 0 0 59822 90 0 0 25 0 4 0 669730165 2520248320 548287 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2461180 CPUtime=866.16 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154801 0 0 0 86510 106 0 0 25 0 4 0 669730165 2520248320 548287 33554432000 4194304 4625164 140736678575184 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2461180 CPUtime=559.92 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3411572 0 0 0 55443 549 0 0 25 0 4 0 669730165 2520248320 548287 33554432000 4194304 4625164 140736678575184 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3005.63
Current children cumulated vsize (KiB) 2461180

[startup+1062.3 s]
/proc/loadavg: 10.19 10.20 10.13 11/352 6236
/proc/meminfo: memFree=13120840/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2526716 CPUtime=3185.61 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 3979255 0 0 0 317777 784 0 0 25 0 4 0 669730162 2587357184 555776 33554432000 4194304 4625164 140736678575184 18446744073709551615 4512736 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 631679 555776 362 106 0 627182 0
[pid=6143/tid=6145] ppid=6141 vsize=2526716 CPUtime=629.12 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 208892 0 0 0 62818 94 0 0 25 0 4 0 669730165 2587357184 555776 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2526716 CPUtime=926.15 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154872 0 0 0 92509 106 0 0 25 0 4 0 669730165 2587357184 555776 33554432000 4194304 4625164 140736678575184 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2526716 CPUtime=589.91 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3515157 0 0 0 58424 567 0 0 25 0 4 0 669730165 2587357184 555776 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3185.61
Current children cumulated vsize (KiB) 2526716

[startup+1122.31 s]
/proc/loadavg: 10.15 10.19 10.13 12/352 6238
/proc/meminfo: memFree=13022240/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2640024 CPUtime=3365.66 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 4259379 0 0 0 335734 832 0 0 25 0 4 0 669730162 2703384576 572002 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 660006 572002 362 106 0 655509 0
[pid=6143/tid=6145] ppid=6141 vsize=2640024 CPUtime=659.13 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 270513 0 0 0 65809 104 0 0 25 0 4 0 669730165 2703384576 572002 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2640024 CPUtime=986.17 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 154941 0 0 0 98511 106 0 0 25 0 4 0 669730165 2703384576 572002 33554432000 4194304 4625164 140736678575184 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2640024 CPUtime=619.91 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3733003 0 0 0 61387 604 0 0 25 0 4 0 669730165 2703384576 572002 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3365.66
Current children cumulated vsize (KiB) 2640024

[startup+1182.3 s]
/proc/loadavg: 10.13 10.18 10.13 12/352 6240
/proc/meminfo: memFree=12936664/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2702252 CPUtime=3545.63 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 4523054 0 0 0 353683 880 0 0 25 0 4 0 669730162 2767106048 584390 33554432000 4194304 4625164 140736678575184 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 675563 584390 365 106 0 671066 0
[pid=6143/tid=6145] ppid=6141 vsize=2702252 CPUtime=689.22 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 272648 0 0 0 68814 108 0 0 25 0 4 0 669730165 2767106048 584390 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2702252 CPUtime=1046.16 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 155005 0 0 0 104510 106 0 0 25 0 4 0 669730165 2767106048 584390 33554432000 4194304 4625164 140736678575184 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2702252 CPUtime=649.81 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 3960566 0 0 0 64338 643 0 0 25 0 4 0 669730165 2767106048 584390 33554432000 4194304 4625164 140736678575184 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3545.63
Current children cumulated vsize (KiB) 2702252

[startup+1242.3 s]
/proc/loadavg: 10.19 10.19 10.13 12/352 6241
/proc/meminfo: memFree=12877252/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2767920 CPUtime=3725.64 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 4738468 0 0 0 371645 919 0 0 25 0 4 0 669730162 2834350080 594040 33554432000 4194304 4625164 140736678575184 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 691980 594040 366 106 0 687483 0
[pid=6143/tid=6145] ppid=6141 vsize=2767920 CPUtime=719.22 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 274516 0 0 0 71810 112 0 0 25 0 4 0 669730165 2834350080 594040 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2767920 CPUtime=1106.16 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 155072 0 0 0 110510 106 0 0 25 0 4 0 669730165 2834350080 594040 33554432000 4194304 4625164 140736678575184 18446744073709551615 4488027 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2767920 CPUtime=679.81 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 4173292 0 0 0 67304 677 0 0 25 0 4 0 669730165 2834350080 594040 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3725.64
Current children cumulated vsize (KiB) 2767920



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.30 10.22 10.14 11/352 6243
/proc/meminfo: memFree=12819448/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2768052 CPUtime=3898.76 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 4951650 0 0 0 388919 957 0 0 25 0 4 0 669730162 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 692013 602785 361 106 0 687516 0
[pid=6143/tid=6145] ppid=6141 vsize=2768052 CPUtime=748.12 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 276384 0 0 0 74697 115 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2768052 CPUtime=1163.87 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 155142 0 0 0 116281 106 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2768052 CPUtime=708.64 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 4384142 0 0 0 70151 713 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3898.76
Current children cumulated vsize (KiB) 2768052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 10.30 10.22 10.14 11/352 6243
/proc/meminfo: memFree=12819448/32951124 swapFree=54450792/67111528
[pid=6143] ppid=6141 vsize=2768052 CPUtime=3898.76 cores=1,3,5,7
/proc/6143/stat : 6143 (SArTagnan) R 6141 6143 5768 0 -1 4202496 4951650 0 0 0 388919 957 0 0 25 0 4 0 669730162 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6143/statm: 692013 602785 361 106 0 687516 0
[pid=6143/tid=6145] ppid=6141 vsize=2768052 CPUtime=748.12 cores=1,3,5,7
/proc/6143/task/6145/stat : 6145 (SArTagnan) R 6141 6143 5768 0 -1 4202560 276384 0 0 0 74697 115 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6143/tid=6146] ppid=6141 vsize=2768052 CPUtime=1163.87 cores=1,3,5,7
/proc/6143/task/6146/stat : 6146 (SArTagnan) R 6141 6143 5768 0 -1 4202560 155142 0 0 0 116281 106 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6143/tid=6147] ppid=6141 vsize=2768052 CPUtime=708.64 cores=1,3,5,7
/proc/6143/task/6147/stat : 6147 (SArTagnan) R 6141 6143 5768 0 -1 4202560 4384142 0 0 0 70151 713 0 0 25 0 4 0 669730165 2834485248 602785 33554432000 4194304 4625164 140736678575184 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3898.76
Current children cumulated vsize (KiB) 2768052

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.11
CPU time (s): 3898.9
CPU user time (s): 3889.23
CPU system time (s): 9.66653
CPU usage (%): 299.889
Max. virtual memory (cumulated for all children) (KiB): 2853760

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3889.23
system time used= 9.66653
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4951650
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8054
involuntary context switches= 25355

runsolver used 4.02739 second user time and 10.2904 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-16 23:28:40
IDJOB=3385878
IDBENCH=83178
IDSOLVER=1871
FILE ID=node134/3385878-1305581320
RUNJOBID= node134-1305577288-5787
PBS_JOBID= 13350221
Free space on /tmp= 73576 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x40.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385878-1305581320/watcher-3385878-1305581320 -o /tmp/evaluation-result-3385878-1305581320/solver-3385878-1305581320 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385878-1305581320.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a7a68cedc6ab84c0df9c27d166b0b6b
RANDOM SEED=1903145039

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15792560 kB
Buffers:        167100 kB
Cached:         723204 kB
SwapCached:      16428 kB
Active:        5793136 kB
Inactive:     11125364 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15792560 kB
SwapTotal:    67111528 kB
SwapFree:     54450792 kB
Dirty:            1184 kB
Writeback:           0 kB
AnonPages:    16019540 kB
Mapped:          16608 kB
Slab:            97904 kB
PageTables:      79348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 73871992 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73576 MiB
End job on node134 at 2011-05-16 23:50:22