Trace number 3275451

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.6 5003.82

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x39.cnf
MD5SUMe7679ca49bb432c9b90305d907365c4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3276
Number of clauses628173
Sum of the clauses size2502864
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24914
Number of clauses of size 30
Number of clauses of size 4623259
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275451-1304167355/watcher-3275451-1304167355 -o /tmp/evaluation-result-3275451-1304167355/solver-3275451-1304167355 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275451-1304167355.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.37 7.92 7.96 2/170 9528
/proc/meminfo: memFree=28990340/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2826088480826 0 0 17 2 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0

[startup+0.043424 s]
/proc/loadavg: 7.37 7.92 7.96 2/170 9528
/proc/meminfo: memFree=28990340/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100421 s]
/proc/loadavg: 7.37 7.92 7.96 2/170 9528
/proc/meminfo: memFree=28990340/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300378 s]
/proc/loadavg: 7.37 7.92 7.96 2/170 9528
/proc/meminfo: memFree=28990340/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 23 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700302 s]
/proc/loadavg: 7.37 7.92 7.96 2/170 9528
/proc/meminfo: memFree=28990340/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 23 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5011 s]
/proc/loadavg: 7.37 7.92 7.96 9/180 9543
/proc/meminfo: memFree=28585276/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 23 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=90520 CPUtime=1.49 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 12448 0 0 0 147 2 0 0 20 0 1 0 606966272 92692480 12334 33554432000 4194304 4587354 140735772782592 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 22630 12334 304 96 0 19192 0
[pid=9530] ppid=9528 vsize=67656 CPUtime=1.48 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 16826 0 0 0 146 2 0 0 20 0 1 0 606966272 69279744 14017 33554432000 4194304 4785740 140733965248112 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 16914 14017 313 145 0 13959 0
[pid=9531] ppid=9528 vsize=500836 CPUtime=1.49 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 14944 0 0 0 147 2 0 0 20 0 1 0 606966272 512856064 14841 33554432000 134512640 134534564 4290097920 18446744073709551615 134524745 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 125209 14841 91 6 0 123875 0
[pid=9532] ppid=9528 vsize=83456 CPUtime=1.48 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 52451 0 0 0 141 7 0 0 20 0 1 0 606966272 85458944 9194 33554432000 4194304 4331988 140735133925728 18446744073709551615 251367572586 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 20864 9018 147 34 0 19306 0
[pid=9533] ppid=9528 vsize=293652 CPUtime=3.64 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 52426 1251 0 0 357 7 0 0 18 0 5 0 606966272 300699648 45457 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 73413 45457 157 40 0 71957 0
[pid=9533/tid=9540] ppid=9528 vsize=293652 CPUtime=0.72 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 4713 1251 0 0 71 1 0 0 18 0 5 0 606966349 300699648 45457 33554432000 4194304 4356188 140736198284768 18446744073709551615 4212357 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=293652 CPUtime=0.69 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 4724 1251 0 0 69 0 0 0 24 0 5 0 606966349 300699648 45457 33554432000 4194304 4356188 140736198284768 18446744073709551615 4219783 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=293652 CPUtime=0.72 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 4751 1251 0 0 72 0 0 0 24 0 5 0 606966349 300699648 45457 33554432000 4194304 4356188 140736198284768 18446744073709551615 4315734 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=293652 CPUtime=0.71 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 4715 1251 0 0 71 0 0 0 21 0 5 0 606966349 300699648 45457 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.58
Current children cumulated vsize (KiB) 1054444

[startup+3.1008 s]
/proc/loadavg: 7.37 7.92 7.96 9/180 9543
/proc/meminfo: memFree=28489824/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 16 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=175936 CPUtime=3.09 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 45357 0 0 0 302 7 0 0 25 0 1 0 606966272 180158464 33098 33554432000 4194304 4587354 140735772782592 18446744073709551615 4388338 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 43984 33098 314 96 0 40546 0
[pid=9530] ppid=9528 vsize=67656 CPUtime=3.08 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 16826 0 0 0 306 2 0 0 25 0 1 0 606966272 69279744 14017 33554432000 4194304 4785740 140733965248112 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 16914 14017 313 145 0 13959 0
[pid=9531] ppid=9528 vsize=500836 CPUtime=3.08 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 14944 0 0 0 306 2 0 0 25 0 1 0 606966272 512856064 14841 33554432000 134512640 134534564 4290097920 18446744073709551615 134524582 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 125209 14841 91 6 0 123875 0
[pid=9532] ppid=9528 vsize=92784 CPUtime=3.09 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 72152 0 0 0 299 10 0 0 25 0 1 0 606966272 95010816 15629 33554432000 4194304 4331988 140735133925728 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 23196 15629 150 34 0 21638 0
[pid=9533] ppid=9528 vsize=333848 CPUtime=10.03 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 62524 1251 0 0 994 9 0 0 18 0 5 0 606966272 341860352 55503 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 83462 55503 162 40 0 82006 0
[pid=9533/tid=9540] ppid=9528 vsize=333848 CPUtime=2.32 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 7821 1251 0 0 230 2 0 0 21 0 5 0 606966349 341860352 55503 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292853 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=333848 CPUtime=2.29 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 7818 1251 0 0 228 1 0 0 25 0 5 0 606966349 341860352 55503 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292853 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=333848 CPUtime=2.33 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 7815 1251 0 0 232 1 0 0 25 0 5 0 606966349 341860352 55503 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292853 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=333848 CPUtime=2.31 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 5547 1251 0 0 231 0 0 0 25 0 5 0 606966349 341860352 55503 33554432000 4194304 4356188 140736198284768 18446744073709551615 4323553 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.37
Current children cumulated vsize (KiB) 1189384

[startup+6.30121 s]
/proc/loadavg: 7.42 7.92 7.96 9/180 9543
/proc/meminfo: memFree=28361096/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 16 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=203408 CPUtime=6.28 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 51625 0 0 0 621 7 0 0 25 0 1 0 606966272 208289792 39267 33554432000 4194304 4587354 140735772782592 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 50852 39267 315 96 0 47414 0
[pid=9530] ppid=9528 vsize=68848 CPUtime=6.29 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 17147 0 0 0 626 3 0 0 25 0 1 0 606966272 70500352 14338 33554432000 4194304 4785740 140733965248112 18446744073709551615 4482824 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 17212 14338 316 145 0 14257 0
[pid=9531] ppid=9528 vsize=500836 CPUtime=6.28 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 14944 0 0 0 626 2 0 0 25 0 1 0 606966272 512856064 14841 33554432000 134512640 134534564 4290097920 18446744073709551615 134524550 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 125209 14841 91 6 0 123875 0
[pid=9532] ppid=9528 vsize=92784 CPUtime=6.29 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 72152 0 0 0 619 10 0 0 25 0 1 0 606966272 95010816 15629 33554432000 4194304 4331988 140735133925728 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 23196 15629 150 34 0 21638 0
[pid=9533] ppid=9528 vsize=408660 CPUtime=22.82 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 81227 1251 0 0 2271 11 0 0 18 0 5 0 606966272 418467840 74206 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 102165 74206 162 40 0 100709 0
[pid=9533/tid=9540] ppid=9528 vsize=408660 CPUtime=5.52 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 13908 1251 0 0 549 3 0 0 25 0 5 0 606966349 418467840 74206 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292802 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=408660 CPUtime=5.48 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 13905 1251 0 0 546 2 0 0 25 0 5 0 606966349 418467840 74206 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292829 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=408660 CPUtime=5.52 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 13902 1251 0 0 551 1 0 0 25 0 5 0 606966349 418467840 74206 33554432000 4194304 4356188 140736198284768 18446744073709551615 4292821 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=408660 CPUtime=5.51 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 5989 1251 0 0 551 0 0 0 25 0 5 0 606966349 418467840 74206 33554432000 4194304 4356188 140736198284768 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 47.96
Current children cumulated vsize (KiB) 1292860

[startup+12.701 s]
/proc/loadavg: 7.46 7.92 7.96 9/180 9543
/proc/meminfo: memFree=28397112/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 16 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=211488 CPUtime=12.69 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 63684 0 0 0 1259 10 0 0 25 0 1 0 606966272 216563712 44234 33554432000 4194304 4587354 140735772782592 18446744073709551615 4357924 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 52872 44234 315 96 0 49434 0
[pid=9530] ppid=9528 vsize=79452 CPUtime=12.69 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 19773 0 0 0 1265 4 0 0 25 0 1 0 606966272 81358848 16964 33554432000 4194304 4785740 140733965248112 18446744073709551615 4493842 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 19863 16964 316 145 0 16908 0
[pid=9531] ppid=9528 vsize=500836 CPUtime=12.68 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 14944 0 0 0 1266 2 0 0 25 0 1 0 606966272 512856064 14841 33554432000 134512640 134534564 4290097920 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 125209 14841 91 6 0 123875 0
[pid=9532] ppid=9528 vsize=92784 CPUtime=12.69 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 72152 0 0 0 1259 10 0 0 25 0 1 0 606966272 95010816 15629 33554432000 4194304 4331988 140735133925728 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 23196 15629 150 34 0 21638 0
[pid=9533] ppid=9528 vsize=315480 CPUtime=48.38 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 81689 1251 0 0 4826 12 0 0 18 0 5 0 606966272 323051520 50911 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 78870 50911 162 40 0 77414 0
[pid=9533/tid=9540] ppid=9528 vsize=315480 CPUtime=11.92 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 13908 1251 0 0 1189 3 0 0 25 0 5 0 606966349 323051520 50911 33554432000 4194304 4356188 140736198284768 18446744073709551615 4322401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=315480 CPUtime=11.84 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 13905 1251 0 0 1182 2 0 0 25 0 5 0 606966349 323051520 50911 33554432000 4194304 4356188 140736198284768 18446744073709551615 4286968 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=315480 CPUtime=11.92 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 14030 1251 0 0 1191 1 0 0 25 0 5 0 606966349 323051520 50911 33554432000 4194304 4356188 140736198284768 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=315480 CPUtime=11.91 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 6323 1251 0 0 1191 0 0 0 25 0 5 0 606966349 323051520 50911 33554432000 4194304 4356188 140736198284768 18446744073709551615 4219632 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 99.13
Current children cumulated vsize (KiB) 1218364

[startup+25.5007 s]
/proc/loadavg: 7.58 7.92 7.96 9/180 9544
/proc/meminfo: memFree=28292224/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=275148 CPUtime=25.49 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 88517 0 0 0 2536 13 0 0 25 0 1 0 606966272 281751552 61913 33554432000 4194304 4587354 140735772782592 18446744073709551615 4364688 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=9531] ppid=9528 vsize=515224 CPUtime=4781.63 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 20779 0 0 0 478157 6 0 0 25 0 1 0 606966272 527589376 20676 33554432000 134512640 134534564 4290097920 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 128806 20676 95 6 0 127472 0
[pid=9532] ppid=9528 vsize=148684 CPUtime=4782.44 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 86411 0 0 0 478232 12 0 0 25 0 1 0 606966272 152252416 24402 33554432000 4194304 4331988 140735133925728 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 37171 24402 173 34 0 35613 0
[pid=9533] ppid=9528 vsize=569728 CPUtime=19100.8 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 2091248 1251 0 0 1909785 293 0 0 18 0 5 0 606966272 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 142432 114473 162 40 0 140976 0
[pid=9533/tid=9540] ppid=9528 vsize=569728 CPUtime=4781.68 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 600592 1251 0 0 478088 80 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4238574 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=569728 CPUtime=4755.57 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 580215 1251 0 0 475477 80 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=569728 CPUtime=4781.52 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 595589 1251 0 0 478067 85 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=569728 CPUtime=4781.21 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 281329 1251 0 0 478079 42 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38229.7
Current children cumulated vsize (KiB) 3387944

[startup+4842.3 s]
/proc/loadavg: 8.04 8.02 8.00 9/180 9693
/proc/meminfo: memFree=27422496/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=1467240 CPUtime=4842.43 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 6493329 0 0 0 482569 1674 0 0 25 0 1 0 606966272 1502453760 74043 33554432000 4194304 4587354 140735772782592 18446744073709551615 251367243409 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 366810 74043 337 96 0 363372 0
[pid=9530] ppid=9528 vsize=679232 CPUtime=4842.43 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 162583 0 0 0 484192 51 0 0 25 0 1 0 606966272 695533568 158547 33554432000 4194304 4785740 140733965248112 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 169808 158547 340 145 0 166853 0
[pid=9531] ppid=9528 vsize=515224 CPUtime=4841.64 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 20779 0 0 0 484157 7 0 0 25 0 1 0 606966272 527589376 20676 33554432000 134512640 134534564 4290097920 18446744073709551615 134528993 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 128806 20676 95 6 0 127472 0
[pid=9532] ppid=9528 vsize=148684 CPUtime=4842.44 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 86411 0 0 0 484232 12 0 0 25 0 1 0 606966272 152252416 24402 33554432000 4194304 4331988 140735133925728 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 37171 24402 173 34 0 35613 0
[pid=9533] ppid=9528 vsize=569728 CPUtime=19340.4 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 2095344 1251 0 0 1933751 293 0 0 18 0 5 0 606966272 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 142432 114473 162 40 0 140976 0
[pid=9533/tid=9540] ppid=9528 vsize=569728 CPUtime=4841.68 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 600592 1251 0 0 484088 80 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4298497 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=569728 CPUtime=4815.24 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 580215 1251 0 0 481444 80 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4280959 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=569728 CPUtime=4841.53 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 597637 1251 0 0 484067 86 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=569728 CPUtime=4841.21 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 283377 1251 0 0 484079 42 0 0 25 0 5 0 606966349 583401472 114473 33554432000 4194304 4356188 140736198284768 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38709.4
Current children cumulated vsize (KiB) 3398432

[startup+4902.3 s]
/proc/loadavg: 8.01 8.02 8.00 9/180 9695
/proc/meminfo: memFree=27430888/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=1467184 CPUtime=4902.44 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 6564317 0 0 0 488547 1697 0 0 25 0 1 0 606966272 1502396416 73527 33554432000 4194304 4587354 140735772782592 18446744073709551615 4414304 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 366796 73527 337 96 0 363358 0
[pid=9530] ppid=9528 vsize=682472 CPUtime=4902.43 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 163343 0 0 0 490192 51 0 0 25 0 1 0 606966272 698851328 159307 33554432000 4194304 4785740 140733965248112 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 170618 159307 340 145 0 167663 0
[pid=9531] ppid=9528 vsize=515224 CPUtime=4901.64 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 20779 0 0 0 490157 7 0 0 25 0 1 0 606966272 527589376 20676 33554432000 134512640 134534564 4290097920 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 128806 20676 95 6 0 127472 0
[pid=9532] ppid=9528 vsize=148684 CPUtime=4902.44 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 86411 0 0 0 490232 12 0 0 25 0 1 0 606966272 152252416 24402 33554432000 4194304 4331988 140735133925728 18446744073709551615 4299219 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 37171 24402 173 34 0 35613 0
[pid=9533] ppid=9528 vsize=561536 CPUtime=19580.1 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 2097392 1251 0 0 1957718 293 0 0 18 0 5 0 606966272 575012864 112425 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 140384 112425 162 40 0 138928 0
[pid=9533/tid=9540] ppid=9528 vsize=561536 CPUtime=4901.68 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 600592 1251 0 0 490088 80 0 0 25 0 5 0 606966349 575012864 112425 33554432000 4194304 4356188 140736198284768 18446744073709551615 4298524 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=561536 CPUtime=4874.91 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 582263 1251 0 0 487411 80 0 0 25 0 5 0 606966349 575012864 112425 33554432000 4194304 4356188 140736198284768 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=561536 CPUtime=4901.53 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 597637 1251 0 0 490067 86 0 0 25 0 5 0 606966349 575012864 112425 33554432000 4194304 4356188 140736198284768 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=561536 CPUtime=4901.2 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 283377 1251 0 0 490078 42 0 0 25 0 5 0 606966349 575012864 112425 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39189.1
Current children cumulated vsize (KiB) 3393424

[startup+4962.3 s]
/proc/loadavg: 8.04 8.03 8.00 9/180 9696
/proc/meminfo: memFree=27432716/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=1466016 CPUtime=4962.43 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 6635031 0 0 0 494525 1718 0 0 25 0 1 0 606966272 1501200384 72302 33554432000 4194304 4587354 140735772782592 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 366504 72302 337 96 0 363066 0
[pid=9530] ppid=9528 vsize=682472 CPUtime=4962.43 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 163343 0 0 0 496192 51 0 0 25 0 1 0 606966272 698851328 159307 33554432000 4194304 4785740 140733965248112 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 170618 159307 340 145 0 167663 0
[pid=9531] ppid=9528 vsize=515224 CPUtime=4961.64 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 20779 0 0 0 496157 7 0 0 25 0 1 0 606966272 527589376 20676 33554432000 134512640 134534564 4290097920 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 128806 20676 95 6 0 127472 0
[pid=9532] ppid=9528 vsize=148684 CPUtime=4962.44 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 86411 0 0 0 496232 12 0 0 25 0 1 0 606966272 152252416 24402 33554432000 4194304 4331988 140735133925728 18446744073709551615 4210468 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 37171 24402 173 34 0 35613 0
[pid=9533] ppid=9528 vsize=563588 CPUtime=19819.8 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 2106609 1251 0 0 1981684 295 0 0 18 0 5 0 606966272 577114112 112938 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 140897 112938 162 40 0 139441 0
[pid=9533/tid=9540] ppid=9528 vsize=563588 CPUtime=4961.68 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 602640 1251 0 0 496088 80 0 0 25 0 5 0 606966349 577114112 112938 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=563588 CPUtime=4934.58 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 584311 1251 0 0 493378 80 0 0 25 0 5 0 606966349 577114112 112938 33554432000 4194304 4356188 140736198284768 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=563588 CPUtime=4961.53 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 599685 1251 0 0 496067 86 0 0 25 0 5 0 606966349 577114112 112938 33554432000 4194304 4356188 140736198284768 18446744073709551615 4334215 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=563588 CPUtime=4961.2 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 286450 1251 0 0 496077 43 0 0 25 0 5 0 606966349 577114112 112938 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39668.7
Current children cumulated vsize (KiB) 3394308



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.8 s]
/proc/loadavg: 8.02 8.02 8.00 9/180 9697
/proc/meminfo: memFree=27478816/32950928 swapFree=67111352/67111528
[pid=9528] ppid=9526 vsize=18324 CPUtime=0 cores=0-7
/proc/9528/stat : 9528 (ppfolio) S 9526 9528 9020 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606966272 18763776 389 33554432000 4194304 4287625 140736914788192 18446744073709551615 251367566863 0 0 4096 65536 2671901770476683263 0 0 17 6 0 0 0
/proc/9528/statm: 4581 389 341 23 0 91 0
[pid=9529] ppid=9528 vsize=1467596 CPUtime=5003.95 cores=0
/proc/9529/stat : 9529 (cryptominisat) R 9528 9528 9020 0 -1 4202496 6694055 0 0 0 498660 1735 0 0 25 0 1 0 606966272 1502818304 59467 33554432000 4194304 4587354 140735772782592 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9529/statm: 366899 59467 337 96 0 363461 0
[pid=9530] ppid=9528 vsize=682472 CPUtime=5003.95 cores=1
/proc/9530/stat : 9530 (clasp) R 9528 9528 9020 0 -1 4202496 163343 0 0 0 500344 51 0 0 25 0 1 0 606966272 698851328 159307 33554432000 4194304 4785740 140733965248112 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9530/statm: 170618 159307 340 145 0 167663 0
[pid=9531] ppid=9528 vsize=515224 CPUtime=5003.16 cores=2
/proc/9531/stat : 9531 (TNM) R 9528 9528 9020 0 -1 4202496 20779 0 0 0 500309 7 0 0 25 0 1 0 606966272 527589376 20676 33554432000 134512640 134534564 4290097920 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9531/statm: 128806 20676 95 6 0 127472 0
[pid=9532] ppid=9528 vsize=148684 CPUtime=5003.96 cores=3
/proc/9532/stat : 9532 (march_hi) R 9528 9528 9020 0 -1 4202496 86411 0 0 0 500384 12 0 0 25 0 1 0 606966272 152252416 24402 33554432000 4194304 4331988 140735133925728 18446744073709551615 4286225 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9532/statm: 37171 24402 173 34 0 35613 0
[pid=9533] ppid=9528 vsize=568324 CPUtime=19985.6 cores=4-7
/proc/9533/stat : 9533 (plingeling) S 9528 9528 9020 0 -1 4202496 2111057 1251 0 0 1998266 295 0 0 18 0 5 0 606966272 581963776 114154 33554432000 4194304 4356188 140736198284768 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/9533/statm: 142081 114154 162 40 0 140625 0
[pid=9533/tid=9540] ppid=9528 vsize=568324 CPUtime=5003.19 cores=4-7
/proc/9533/task/9540/stat : 9540 (plingeling) R 9528 9528 9020 0 -1 4202560 604688 1251 0 0 500239 80 0 0 25 0 5 0 606966349 581963776 114154 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331631 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9533/tid=9541] ppid=9528 vsize=568324 CPUtime=4975.86 cores=4-7
/proc/9533/task/9541/stat : 9541 (plingeling) R 9528 9528 9020 0 -1 4202560 584311 1251 0 0 497506 80 0 0 25 0 5 0 606966349 581963776 114154 33554432000 4194304 4356188 140736198284768 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=9533/tid=9542] ppid=9528 vsize=568324 CPUtime=5003.04 cores=4-7
/proc/9533/task/9542/stat : 9542 (plingeling) R 9528 9528 9020 0 -1 4202560 602085 1251 0 0 500218 86 0 0 25 0 5 0 606966349 581963776 114154 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9533/tid=9543] ppid=9528 vsize=568324 CPUtime=5002.71 cores=4-7
/proc/9533/task/9543/stat : 9543 (plingeling) R 9528 9528 9020 0 -1 4202560 286450 1251 0 0 500228 43 0 0 25 0 5 0 606966349 581963776 114154 33554432000 4194304 4356188 140736198284768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 3400624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9528 and gives
#  childrusage.ru_utime.tv_sec=10006
#  childrusage.ru_utime.tv_usec=932714
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=215967
# CPU time returned by wait4() is 10007.1
# while last known CPU time is 40000.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.82
CPU time (s): 40000.6
CPU user time (s): 39979.6
CPU system time (s): 21
CPU usage (%): 799.401
Max. virtual memory (cumulated for all children) (KiB): 4794016

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10006.9
system time used= 0.215967
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 107711
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 541
involuntary context switches= 22993

runsolver used 7.64684 second user time and 19.657 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-30 14:42:36
IDJOB=3275451
IDBENCH=83184
IDSOLVER=1638
FILE ID=node113/3275451-1304167355
RUNJOBID= node113-1304162219-9034
PBS_JOBID= 13170938
Free space on /tmp= 72380 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x39.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275451-1304167355/watcher-3275451-1304167355 -o /tmp/evaluation-result-3275451-1304167355/solver-3275451-1304167355 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275451-1304167355.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e7679ca49bb432c9b90305d907365c4e
RANDOM SEED=1796287975

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28990496 kB
Buffers:        766824 kB
Cached:        2624100 kB
SwapCached:         12 kB
Active:         230508 kB
Inactive:      3223560 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28990496 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:           25108 kB
Writeback:           0 kB
AnonPages:       63448 kB
Mapped:          14536 kB
Slab:           439340 kB
PageTables:       4280 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   186692 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72372 MiB
End job on node113 at 2011-04-30 16:06:02