Trace number 3219279

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39971.5 5000.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S926861876-013-UNKNOWN.cnf
MD5SUMaa5d2fab702f701bf63e2d26e76ab2b3
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219279-1304149877/watcher-3219279-1304149877 -o /tmp/evaluation-result-3219279-1304149877/solver-3219279-1304149877 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3219279-1304149877.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.87 7.91 1/170 8725
/proc/meminfo: memFree=24359616/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 2826088480817 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0

[startup+0.0500059 s]
/proc/loadavg: 7.36 7.87 7.91 1/170 8725
/proc/meminfo: memFree=24359616/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.167951 s]
/proc/loadavg: 7.36 7.87 7.91 1/170 8725
/proc/meminfo: memFree=24359616/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300931 s]
/proc/loadavg: 7.36 7.87 7.91 1/170 8725
/proc/meminfo: memFree=24359616/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700854 s]
/proc/loadavg: 7.36 7.87 7.91 1/170 8725
/proc/meminfo: memFree=24359616/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 19 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50071 s]
/proc/loadavg: 7.36 7.87 7.91 9/180 8740
/proc/meminfo: memFree=24317236/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2049176 CPUtime=1.48 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 5786 0 0 0 148 0 0 0 20 0 1 0 526585436 2098356224 1855 33554432000 4194304 4587354 140737069528992 18446744073709551615 4239304 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 512294 1855 327 96 0 508856 0
[pid=8727] ppid=8725 vsize=21372 CPUtime=1.49 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 2866 0 0 0 149 0 0 0 20 0 1 0 526585436 21884928 2670 33554432000 4194304 4785740 140733230329088 18446744073709551615 4286941 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 5343 2670 340 145 0 2388 0
[pid=8728] ppid=8725 vsize=455032 CPUtime=1.49 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1151 0 0 0 149 0 0 0 25 0 1 0 526585436 465952768 1047 33554432000 134512640 134534564 4288646208 18446744073709551615 134524736 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 113758 1047 91 6 0 112424 0
[pid=8729] ppid=8725 vsize=10932 CPUtime=1.48 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 4744 0 0 0 148 0 0 0 20 0 1 0 526585436 11194368 1063 33554432000 4194304 4331988 140735957164416 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 2733 1063 150 34 0 1175 0
[pid=8730] ppid=8725 vsize=125052 CPUtime=5.8 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 5952 1253 0 0 579 1 0 0 18 0 5 0 526585436 128053248 3328 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 31263 3328 161 40 0 29807 0
[pid=8730/tid=8737] ppid=8725 vsize=125052 CPUtime=1.44 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 572 1253 0 0 144 0 0 0 20 0 5 0 526585441 128053248 3328 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=125052 CPUtime=1.43 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 581 1253 0 0 143 0 0 0 23 0 5 0 526585441 128053248 3328 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=125052 CPUtime=1.44 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 542 1253 0 0 144 0 0 0 23 0 5 0 526585441 128053248 3328 33554432000 4194304 4356188 140733735700080 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=125052 CPUtime=1.42 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 658 1253 0 0 142 0 0 0 23 0 5 0 526585441 128053248 3328 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.74
Current children cumulated vsize (KiB) 2679888

[startup+3.10042 s]
/proc/loadavg: 7.36 7.87 7.91 9/180 8740
/proc/meminfo: memFree=24316740/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2067352 CPUtime=3.08 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 12670 0 0 0 307 1 0 0 25 0 1 0 526585436 2116968448 6631 33554432000 4194304 4587354 140737069528992 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 516838 6631 337 96 0 513400 0
[pid=8727] ppid=8725 vsize=22972 CPUtime=3.09 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 3271 0 0 0 309 0 0 0 25 0 1 0 526585436 23523328 3075 33554432000 4194304 4785740 140733230329088 18446744073709551615 4286964 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 5743 3075 340 145 0 2788 0
[pid=8728] ppid=8725 vsize=455032 CPUtime=3.09 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1151 0 0 0 309 0 0 0 25 0 1 0 526585436 465952768 1047 33554432000 134512640 134534564 4288646208 18446744073709551615 134524712 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 113758 1047 91 6 0 112424 0
[pid=8729] ppid=8725 vsize=14320 CPUtime=3.08 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 5787 0 0 0 308 0 0 0 25 0 1 0 526585436 14663680 1731 33554432000 4194304 4331988 140735957164416 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 3580 1731 174 34 0 2022 0
[pid=8730] ppid=8725 vsize=126940 CPUtime=12.19 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 6431 1253 0 0 1218 1 0 0 18 0 5 0 526585436 129986560 3807 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 31735 3807 161 40 0 30279 0
[pid=8730/tid=8737] ppid=8725 vsize=126940 CPUtime=3.04 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 668 1253 0 0 304 0 0 0 25 0 5 0 526585441 129986560 3807 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=126940 CPUtime=3.03 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 751 1253 0 0 303 0 0 0 25 0 5 0 526585441 129986560 3807 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=126940 CPUtime=3.04 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 643 1253 0 0 304 0 0 0 25 0 5 0 526585441 129986560 3807 33554432000 4194304 4356188 140733735700080 18446744073709551615 4282000 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=126940 CPUtime=3.02 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 770 1253 0 0 302 0 0 0 25 0 5 0 526585441 129986560 3807 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.53
Current children cumulated vsize (KiB) 2704940

[startup+6.30084 s]
/proc/loadavg: 7.49 7.89 7.92 9/180 8740
/proc/meminfo: memFree=24291716/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2056404 CPUtime=6.29 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 13395 0 0 0 627 2 0 0 25 0 1 0 526585436 2105757696 6123 33554432000 4194304 4587354 140737069528992 18446744073709551615 4245506 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 514101 6123 337 96 0 510663 0
[pid=8727] ppid=8725 vsize=25608 CPUtime=6.29 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 3917 0 0 0 629 0 0 0 25 0 1 0 526585436 26222592 3721 33554432000 4194304 4785740 140733230329088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 6402 3721 340 145 0 3447 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=6.29 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 629 0 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=14320 CPUtime=6.28 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 5787 0 0 0 628 0 0 0 25 0 1 0 526585436 14663680 1731 33554432000 4194304 4331988 140735957164416 18446744073709551615 4237426 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 3580 1731 174 34 0 2022 0
[pid=8730] ppid=8725 vsize=131128 CPUtime=24.97 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 7446 1253 0 0 2496 1 0 0 18 0 5 0 526585436 134275072 4822 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 32782 4822 161 40 0 31326 0
[pid=8730/tid=8737] ppid=8725 vsize=131128 CPUtime=6.24 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 933 1253 0 0 624 0 0 0 25 0 5 0 526585441 134275072 4822 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=131128 CPUtime=6.23 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 976 1253 0 0 623 0 0 0 25 0 5 0 526585441 134275072 4822 33554432000 4194304 4356188 140733735700080 18446744073709551615 4270759 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=131128 CPUtime=6.24 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 909 1253 0 0 624 0 0 0 25 0 5 0 526585441 134275072 4822 33554432000 4194304 4356188 140733735700080 18446744073709551615 4225618 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=131128 CPUtime=6.2 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 1029 1253 0 0 620 0 0 0 25 0 5 0 526585441 134275072 4822 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331738 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.12
Current children cumulated vsize (KiB) 2705072

[startup+12.7007 s]
/proc/loadavg: 7.53 7.89 7.92 9/180 8740
/proc/meminfo: memFree=24286880/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2064688 CPUtime=12.69 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 15634 0 0 0 1267 2 0 0 25 0 1 0 526585436 2114240512 6967 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 516172 6967 337 96 0 512734 0
[pid=8727] ppid=8725 vsize=28216 CPUtime=12.69 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 4548 0 0 0 1269 0 0 0 25 0 1 0 526585436 28893184 4352 33554432000 4194304 4785740 140733230329088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 7054 4352 340 145 0 4099 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=12.69 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 1269 0 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134528893 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=14320 CPUtime=12.68 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 5787 0 0 0 1268 0 0 0 25 0 1 0 526585436 14663680 1731 33554432000 4194304 4331988 140735957164416 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 3580 1731 174 34 0 2022 0
[pid=8730] ppid=8725 vsize=131244 CPUtime=50.54 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 9651 1253 0 0 5052 2 0 0 18 0 5 0 526585436 134393856 4883 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 32811 4883 161 40 0 31355 0
[pid=8730/tid=8737] ppid=8725 vsize=131244 CPUtime=12.63 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 2159 1253 0 0 1263 0 0 0 25 0 5 0 526585441 134393856 4883 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=131244 CPUtime=12.63 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 1089 1253 0 0 1263 0 0 0 25 0 5 0 526585441 134393856 4883 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=131244 CPUtime=12.64 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 1046 1253 0 0 1264 0 0 0 25 0 5 0 526585441 134393856 4883 33554432000 4194304 4356188 140733735700080 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=131244 CPUtime=12.56 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 1758 1253 0 0 1256 0 0 0 25 0 5 0 526585441 134393856 4883 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331335 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.29
Current children cumulated vsize (KiB) 2716080

[startup+25.5013 s]
/proc/loadavg: 7.63 7.89 7.92 9/180 8741
/proc/meminfo: memFree=24289872/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2053580 CPUtime=25.49 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 22102 0 0 0 2545 4 0 0 25 0 1 0 526585436 2102865920 3494 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=8728] ppid=8725 vsize=459288 CPUtime=4782.29 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 478227 2 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134530144 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=697544 CPUtime=4782.42 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 135305 0 0 0 478149 93 0 0 25 0 1 0 526585436 714285056 131249 33554432000 4194304 4331988 140735957164416 18446744073709551615 4299156 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 174386 131249 175 34 0 172828 0
[pid=8730] ppid=8725 vsize=213720 CPUtime=19101.5 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 414122 1253 0 0 1910087 65 0 0 18 0 5 0 526585436 218849280 25502 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 53430 25502 161 40 0 51974 0
[pid=8730/tid=8737] ppid=8725 vsize=213720 CPUtime=4782.38 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 111820 1253 0 0 478222 16 0 0 25 0 5 0 526585441 218849280 25502 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=213720 CPUtime=4781.91 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 92647 1253 0 0 478177 14 0 0 25 0 5 0 526585441 218849280 25502 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=213720 CPUtime=4782.36 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 92164 1253 0 0 478220 16 0 0 25 0 5 0 526585441 218849280 25502 33554432000 4194304 4356188 140733735700080 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=213720 CPUtime=4754.78 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 113892 1253 0 0 475462 16 0 0 25 0 5 0 526585441 218849280 25502 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231
Current children cumulated vsize (KiB) 3669568

[startup+4842.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 8893
/proc/meminfo: memFree=23478096/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2108820 CPUtime=4842.39 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 1038125 0 0 0 483782 457 0 0 25 0 1 0 526585436 2159431680 28077 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238491 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 527205 28077 337 96 0 523767 0
[pid=8727] ppid=8725 vsize=171872 CPUtime=4842.42 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 37376 0 0 0 484234 8 0 0 25 0 1 0 526585436 175996928 36192 33554432000 4194304 4785740 140733230329088 18446744073709551615 4538892 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 42968 36192 340 145 0 40013 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=4842.3 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 484228 2 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=697544 CPUtime=4842.43 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 136992 0 0 0 484148 95 0 0 25 0 1 0 526585436 714285056 132936 33554432000 4194304 4331988 140735957164416 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 174386 132936 175 34 0 172828 0
[pid=8730] ppid=8725 vsize=201052 CPUtime=19341.2 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 414443 1253 0 0 1934053 65 0 0 18 0 5 0 526585436 205877248 22335 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 50263 22335 161 40 0 48807 0
[pid=8730/tid=8737] ppid=8725 vsize=201052 CPUtime=4842.38 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 111820 1253 0 0 484222 16 0 0 25 0 5 0 526585441 205877248 22335 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=201052 CPUtime=4841.9 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 92839 1253 0 0 484176 14 0 0 25 0 5 0 526585441 205877248 22335 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=201052 CPUtime=4842.36 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 92293 1253 0 0 484220 16 0 0 25 0 5 0 526585441 205877248 22335 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=201052 CPUtime=4814.45 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 113892 1253 0 0 481429 16 0 0 25 0 5 0 526585441 205877248 22335 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.7
Current children cumulated vsize (KiB) 3656900

[startup+4902.3 s]
/proc/loadavg: 8.06 8.03 8.00 9/180 8895
/proc/meminfo: memFree=23494824/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2178848 CPUtime=4902.4 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 1043491 0 0 0 489779 461 0 0 25 0 1 0 526585436 2231140352 20074 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 544712 20074 337 96 0 541274 0
[pid=8727] ppid=8725 vsize=172936 CPUtime=4902.43 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 37668 0 0 0 490234 9 0 0 25 0 1 0 526585436 177086464 36412 33554432000 4194304 4785740 140733230329088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 43234 36412 340 145 0 40279 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=4902.3 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 490228 2 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134530524 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=697544 CPUtime=4902.43 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 138682 0 0 0 490147 96 0 0 25 0 1 0 526585436 714285056 134626 33554432000 4194304 4331988 140735957164416 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 174386 134626 175 34 0 172828 0
[pid=8730] ppid=8725 vsize=209888 CPUtime=19580.9 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 418700 1253 0 0 1958021 65 0 0 18 0 5 0 526585436 214925312 24544 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 52472 24544 161 40 0 51016 0
[pid=8730/tid=8737] ppid=8725 vsize=209888 CPUtime=4902.38 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 113228 1253 0 0 490222 16 0 0 25 0 5 0 526585441 214925312 24544 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=209888 CPUtime=4901.9 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 94216 1253 0 0 490176 14 0 0 25 0 5 0 526585441 214925312 24544 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332133 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=209888 CPUtime=4902.37 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 93701 1253 0 0 490221 16 0 0 25 0 5 0 526585441 214925312 24544 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=209888 CPUtime=4874.13 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 113956 1253 0 0 487397 16 0 0 25 0 5 0 526585441 214925312 24544 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.4
Current children cumulated vsize (KiB) 3736828

[startup+4962.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/180 8896
/proc/meminfo: memFree=23467032/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2110072 CPUtime=4962.39 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 1053488 0 0 0 495773 466 0 0 25 0 1 0 526585436 2160713728 21755 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 527518 21755 337 96 0 524080 0
[pid=8727] ppid=8725 vsize=173792 CPUtime=4962.43 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 37845 0 0 0 496234 9 0 0 25 0 1 0 526585436 177963008 36589 33554432000 4194304 4785740 140733230329088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 43448 36589 340 145 0 40493 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=4962.29 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 496227 2 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=697544 CPUtime=4962.43 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 140378 0 0 0 496146 97 0 0 25 0 1 0 526585436 714285056 136322 33554432000 4194304 4331988 140735957164416 18446744073709551615 4237192 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 174386 136322 175 34 0 172828 0
[pid=8730] ppid=8725 vsize=222560 CPUtime=19820.5 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 424748 1253 0 0 1981987 66 0 0 18 0 5 0 526585436 227901440 27712 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 55640 27712 161 40 0 54184 0
[pid=8730/tid=8737] ppid=8725 vsize=222560 CPUtime=4962.39 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 115820 1253 0 0 496222 17 0 0 25 0 5 0 526585441 227901440 27712 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331841 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=222560 CPUtime=4961.9 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 94216 1253 0 0 496176 14 0 0 25 0 5 0 526585441 227901440 27712 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=222560 CPUtime=4962.38 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 93733 1253 0 0 496221 17 0 0 25 0 5 0 526585441 227901440 27712 33554432000 4194304 4356188 140733735700080 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=222560 CPUtime=4933.8 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 117380 1253 0 0 493363 17 0 0 25 0 5 0 526585441 227901440 27712 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332272 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.1
Current children cumulated vsize (KiB) 3681580



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.10 8.05 8.00 9/180 8897
/proc/meminfo: memFree=23454500/32951124 swapFree=67111524/67111528
[pid=8725] ppid=8723 vsize=18324 CPUtime=0 cores=0-7
/proc/8725/stat : 8725 (ppfolio) S 8723 8725 8511 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526585436 18763776 390 33554432000 4194304 4287625 140735361729744 18446744073709551615 212687695375 0 0 4096 65536 4201620549803180031 0 0 17 4 0 0 0
/proc/8725/statm: 4581 390 341 23 0 91 0
[pid=8726] ppid=8725 vsize=2110072 CPUtime=5000.11 cores=0
/proc/8726/stat : 8726 (cryptominisat) R 8725 8725 8511 0 -1 4202496 1058117 0 0 0 499541 470 0 0 25 0 1 0 526585436 2160713728 26341 33554432000 4194304 4587354 140737069528992 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8726/statm: 527518 26341 337 96 0 524080 0
[pid=8727] ppid=8725 vsize=174860 CPUtime=5000.14 cores=1
/proc/8727/stat : 8727 (clasp) R 8725 8725 8511 0 -1 4202496 38060 0 0 0 500005 9 0 0 25 0 1 0 526585436 179056640 36804 33554432000 4194304 4785740 140733230329088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8727/statm: 43715 36804 340 145 0 40760 0
[pid=8728] ppid=8725 vsize=459288 CPUtime=5000 cores=2
/proc/8728/stat : 8728 (TNM) R 8725 8725 8511 0 -1 4202496 1400 0 0 0 499998 2 0 0 25 0 1 0 526585436 470310912 1296 33554432000 134512640 134534564 4288646208 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8728/statm: 114822 1296 95 6 0 113488 0
[pid=8729] ppid=8725 vsize=697544 CPUtime=5000.14 cores=3
/proc/8729/stat : 8729 (march_hi) R 8725 8725 8511 0 -1 4202496 141453 0 0 0 499916 98 0 0 25 0 1 0 526585436 714285056 137397 33554432000 4194304 4331988 140735957164416 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8729/statm: 174386 137397 175 34 0 172828 0
[pid=8730] ppid=8725 vsize=210656 CPUtime=19971.2 cores=4-7
/proc/8730/stat : 8730 (plingeling) S 8725 8725 8511 0 -1 4202496 425260 1253 0 0 1997049 66 0 0 18 0 5 0 526585436 215711744 24736 33554432000 4194304 4356188 140733735700080 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/8730/statm: 52664 24736 161 40 0 51208 0
[pid=8730/tid=8737] ppid=8725 vsize=210656 CPUtime=5000.09 cores=4-7
/proc/8730/task/8737/stat : 8737 (plingeling) R 8725 8725 8511 0 -1 4202560 115820 1253 0 0 499992 17 0 0 25 0 5 0 526585441 215711744 24736 33554432000 4194304 4356188 140733735700080 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8730/tid=8738] ppid=8725 vsize=210656 CPUtime=4999.6 cores=4-7
/proc/8730/task/8738/stat : 8738 (plingeling) R 8725 8725 8511 0 -1 4202560 94216 1253 0 0 499946 14 0 0 25 0 5 0 526585441 215711744 24736 33554432000 4194304 4356188 140733735700080 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8730/tid=8739] ppid=8725 vsize=210656 CPUtime=5000.08 cores=4-7
/proc/8730/task/8739/stat : 8739 (plingeling) R 8725 8725 8511 0 -1 4202560 93733 1253 0 0 499991 17 0 0 25 0 5 0 526585441 215711744 24736 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332007 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8730/tid=8740] ppid=8725 vsize=210656 CPUtime=4971.3 cores=4-7
/proc/8730/task/8740/stat : 8740 (plingeling) R 8725 8725 8511 0 -1 4202560 117892 1253 0 0 497113 17 0 0 25 0 5 0 526585441 215711744 24736 33554432000 4194304 4356188 140733735700080 18446744073709551615 4332165 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39971.5
Current children cumulated vsize (KiB) 3670744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8725 and gives
#  childrusage.ru_utime.tv_sec=14995
#  childrusage.ru_utime.tv_usec=453344
#  childrusage.ru_stime.tv_sec=4
#  childrusage.ru_stime.tv_usec=837264
# CPU time returned by wait4() is 15000.3
# while last known CPU time is 39971.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39971.5
CPU user time (s): 39965.1
CPU system time (s): 6.45
CPU usage (%): 799.428
Max. virtual memory (cumulated for all children) (KiB): 9486840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 14995.5
system time used= 4.83726
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1098116
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 710
involuntary context switches= 29114

runsolver used 8.26274 second user time and 18.9031 second system time

The end

Launcher Data 

Begin job on node139 at 2011-04-30 09:51:17
IDJOB=3219279
IDBENCH=82563
IDSOLVER=1638
FILE ID=node139/3219279-1304149877
RUNJOBID= node139-1304144871-8525
PBS_JOBID= 13170866
Free space on /tmp= 72900 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S926861876-013-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219279-1304149877/watcher-3219279-1304149877 -o /tmp/evaluation-result-3219279-1304149877/solver-3219279-1304149877 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3219279-1304149877.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= aa5d2fab702f701bf63e2d26e76ab2b3
RANDOM SEED=2106730297

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24359648 kB
Buffers:       2060364 kB
Cached:        5946964 kB
SwapCached:          4 kB
Active:        1017420 kB
Inactive:      7053036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24359648 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10884 kB
Writeback:          16 kB
AnonPages:       63784 kB
Mapped:          14676 kB
Slab:           454688 kB
PageTables:       4544 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   184620 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72888 MiB
End job on node139 at 2011-04-30 11:14:39