Trace number 3372458

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (problem) 36849.3 4618.5

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf
MD5SUM28233bedeee44da6e79e63b9febc4d1e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses667976
Sum of the clauses size1591941
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2659295
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

36848.37/4617.60	*** internal error in 'lglib.c': number of redundant large clause literals exhausted

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372458-1305437827/watcher-3372458-1305437827 -o /tmp/evaluation-result-3372458-1305437827/solver-3372458-1305437827 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372458-1305437827.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.38 7.84 6.76 2/301 23583
/proc/meminfo: memFree=14531048/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=11524 CPUtime=0 cores=0-7
/proc/23583/stat : 23583 (plingeling) R 23581 23583 23439 0 -1 4202496 950 1252 0 0 0 0 0 0 21 0 1 0 655381544 11800576 880 33554432000 4194304 4417452 140734554181744 18446744073709551615 235594866432 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/23583/statm: 2881 880 144 55 0 767 0

[startup+0.0635719 s]
/proc/loadavg: 7.38 7.84 6.76 2/301 23583
/proc/meminfo: memFree=14531048/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=21996 CPUtime=0.05 cores=0-7
/proc/23583/stat : 23583 (plingeling) R 23581 23583 23439 0 -1 4202496 3561 1252 0 0 5 0 0 0 21 0 1 0 655381544 22523904 3491 33554432000 4194304 4417452 140734554181744 18446744073709551615 235594227447 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/23583/statm: 5499 3491 149 55 0 3385 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 21996

[startup+0.100569 s]
/proc/loadavg: 7.38 7.84 6.76 2/301 23583
/proc/meminfo: memFree=14531048/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=27412 CPUtime=0.08 cores=0-7
/proc/23583/stat : 23583 (plingeling) R 23581 23583 23439 0 -1 4202496 4947 1252 0 0 8 0 0 0 21 0 1 0 655381544 28069888 4877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4231327 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/23583/statm: 6853 4877 149 55 0 4739 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 27412

[startup+0.300534 s]
/proc/loadavg: 7.38 7.84 6.76 2/301 23583
/proc/meminfo: memFree=14531048/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=62940 CPUtime=0.29 cores=0-7
/proc/23583/stat : 23583 (plingeling) R 23581 23583 23439 0 -1 4202496 13829 1252 0 0 27 2 0 0 22 0 1 0 655381544 64450560 13759 33554432000 4194304 4417452 140734554181744 18446744073709551615 4231303 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/23583/statm: 15735 13759 149 55 0 13621 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 62940

[startup+0.700463 s]
/proc/loadavg: 7.38 7.84 6.76 2/301 23583
/proc/meminfo: memFree=14531048/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=128572 CPUtime=0.69 cores=0-7
/proc/23583/stat : 23583 (plingeling) R 23581 23583 23439 0 -1 4202496 30253 1252 0 0 65 4 0 0 23 0 1 0 655381544 131657728 30167 33554432000 4194304 4417452 140734554181744 18446744073709551615 4320672 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/23583/statm: 32143 30167 149 55 0 30029 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 128572

[startup+1.50033 s]
/proc/loadavg: 7.38 7.84 6.76 2/302 23589
/proc/meminfo: memFree=14405840/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=312516 CPUtime=3.83 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 85232 1252 0 0 371 12 0 0 18 0 9 0 655381544 320016384 48017 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 78129 48017 174 55 0 76015 0
Current children cumulated CPU time (s) 3.83
Current children cumulated vsize (KiB) 312516

[startup+3.10105 s]
/proc/loadavg: 7.38 7.84 6.76 9/310 23597
/proc/meminfo: memFree=14319100/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=336224 CPUtime=16.63 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 113331 1252 0 0 1647 16 0 0 18 0 9 0 655381544 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 84056 52115 177 55 0 81942 0
[pid=23583/tid=23590] ppid=23581 vsize=336224 CPUtime=1.94 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 8757 1252 0 0 193 1 0 0 21 0 9 0 655381659 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23583/tid=23591] ppid=23581 vsize=336224 CPUtime=1.94 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 6388 1252 0 0 193 1 0 0 25 0 9 0 655381659 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4275606 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23583/tid=23592] ppid=23581 vsize=336224 CPUtime=1.89 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5575 1252 0 0 189 0 0 0 25 0 9 0 655381659 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4346428 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23583/tid=23593] ppid=23581 vsize=336224 CPUtime=1.94 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 2249 1252 0 0 194 0 0 0 25 0 9 0 655381659 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23583/tid=23594] ppid=23581 vsize=336224 CPUtime=1.93 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 9179 1252 0 0 192 1 0 0 21 0 9 0 655381660 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=336224 CPUtime=1.92 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 6005 1252 0 0 192 0 0 0 25 0 9 0 655381660 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=336224 CPUtime=1.93 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 10417 1252 0 0 192 1 0 0 25 0 9 0 655381660 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23597] ppid=23581 vsize=336224 CPUtime=1.93 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 6649 1252 0 0 192 1 0 0 25 0 9 0 655381661 344293376 52115 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236623 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 16.63
Current children cumulated vsize (KiB) 336224

[startup+6.30048 s]
/proc/loadavg: 7.51 7.86 6.78 9/310 23597
/proc/meminfo: memFree=14305340/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=356064 CPUtime=42.19 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 130909 1252 0 0 4200 19 0 0 18 0 9 0 655381544 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 89016 55755 180 55 0 86902 0
[pid=23583/tid=23590] ppid=23581 vsize=356064 CPUtime=5.14 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 12980 1252 0 0 513 1 0 0 25 0 9 0 655381659 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4250524 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23583/tid=23591] ppid=23581 vsize=356064 CPUtime=5.13 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 9872 1252 0 0 512 1 0 0 25 0 9 0 655381659 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23583/tid=23592] ppid=23581 vsize=356064 CPUtime=5.05 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5578 1252 0 0 505 0 0 0 25 0 9 0 655381659 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23583/tid=23593] ppid=23581 vsize=356064 CPUtime=5.14 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 2786 1252 0 0 514 0 0 0 25 0 9 0 655381659 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4355849 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23583/tid=23594] ppid=23581 vsize=356064 CPUtime=5.13 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 15507 1252 0 0 511 2 0 0 25 0 9 0 655381660 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=356064 CPUtime=5.12 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 6163 1252 0 0 512 0 0 0 25 0 9 0 655381660 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=356064 CPUtime=5.12 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 11527 1252 0 0 511 1 0 0 25 0 9 0 655381660 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23597] ppid=23581 vsize=356064 CPUtime=5.12 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 8384 1252 0 0 511 1 0 0 25 0 9 0 655381661 364609536 55755 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 42.19
Current children cumulated vsize (KiB) 356064

[startup+12.7004 s]
/proc/loadavg: 7.55 7.87 6.78 9/310 23597
/proc/meminfo: memFree=14260616/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=402228 CPUtime=93.31 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 148512 1252 0 0 9311 20 0 0 18 0 9 0 655381544 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 100557 69916 180 55 0 98443 0
[pid=23583/tid=23590] ppid=23581 vsize=402228 CPUtime=11.54 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 16347 1252 0 0 1152 2 0 0 25 0 9 0 655381659 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23583/tid=23591] ppid=23581 vsize=402228 CPUtime=11.54 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 10673 1252 0 0 1152 2 0 0 25 0 9 0 655381659 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23583/tid=23592] ppid=23581 vsize=402228 CPUtime=11.39 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 6602 1252 0 0 1139 0 0 0 25 0 9 0 655381659 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23583/tid=23593] ppid=23581 vsize=402228 CPUtime=11.53 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 9027 1252 0 0 1153 0 0 0 25 0 9 0 655381659 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357291 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23583/tid=23594] ppid=23581 vsize=402228 CPUtime=11.52 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 16881 1252 0 0 1150 2 0 0 25 0 9 0 655381660 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=402228 CPUtime=11.52 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 8544 1252 0 0 1152 0 0 0 25 0 9 0 655381660 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357265 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=402228 CPUtime=11.52 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 12292 1252 0 0 1151 1 0 0 25 0 9 0 655381660 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23597] ppid=23581 vsize=402228 CPUtime=11.52 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 10034 1252 0 0 1151 1 0 0 25 0 9 0 655381661 411881472 69916 33554432000 4194304 4417452 140734554181744 18446744073709551615 4358748 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 93.31
Current children cumulated vsize (KiB) 402228

[startup+25.5011 s]
/proc/loadavg: 7.65 7.87 6.80 9/310 23598
/proc/meminfo: memFree=14164308/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=467808 CPUtime=195.58 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 186472 1252 0 0 19532 26 0 0 18 0 9 0 655381544 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 116952 91636 180 55 0 114838 0
[pid=23583/tid=23590] ppid=23581 vsize=467808 CPUtime=24.34 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 26788 1252 0 0 2431 3 0 0 25 0 9 0 655381659 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4266906 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23583/tid=23591] ppid=23581 vsize=467808 CPUtime=24.34 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 11905 1252 0 0 2432 2 0 0 25 0 9 0 655381659 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4331828 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23583/tid=23592] ppid=23581 vsize=467808 CPUtime=24.06 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 8409 1252 0 0 2405 1 0 0 25 0 9 0 655381659 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23583/tid=23593] ppid=23581 vsize=467808 CPUtime=24.34 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 18530 1252 0 0 2432 2 0 0 25 0 9 0 655381659 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4356992 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23583/tid=23594] ppid=23581 vsize=467808 CPUtime=24.32 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 27632 1252 0 0 2428 4 0 0 25 0 9 0 655381660 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=467808 CPUtime=24.33 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 9230 1252 0 0 2432 1 0 0 25 0 9 0 655381660 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4232783 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=467808 CPUtime=24.32 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 13880 1252 0 0 2431 1 0 0 25 0 9 0 655381660 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4358093 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23597] ppid=23581 vsize=467808 CPUtime=24.32 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 11986 1252 0 0 2431 1 0 0 25 0 9 0 655381661 479035392 91636 33554432000 4194304 4417452 140734554181744 18446744073709551615 4320487 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 195.58
Current children cumulated vsize (KiB) 467808

[startup+51.1006 s]
/proc/loadavg: 7.77 7.88 6.83 9/310 23598
/proc/meminfo: memFree=13963760/32950928 swapFree=67111348/67111528
[pid=23583] ppid=23581 vsize=647076 CPUtime=400.11 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 264217 1252 0 0 39975 36 0 0 18 0 9 0 655381544 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 161769 133522 180 55 0 159655 0
[pid=23583/tid=23590] ppid=23581 vsize=647076 CPUtime=49.94 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 45608 1252 0 0 4989 5 0 0 25 0 9 0 655381659 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23583/tid=23591] ppid=23581 vsize=647076 CPUtime=49.94 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 11952 1252 0 0 4992 2 0 0 25 0 9 0 655381659 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23583/tid=23592] ppid=23581 vsize=647076 CPUtime=49.62 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 10224 1252 0 0 4961 1 0 0 25 0 9 0 655381659 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23583/tid=23593] ppid=23581 vsize=647076 CPUtime=49.93 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 46924 1252 0 0 4988 5 0 0 25 0 9 0 655381659 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357970 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23583/tid=23594] ppid=23581 vsize=647076 CPUtime=49.92 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 41842 1252 0 0 4986 6 0 0 25 0 9 0 655381660 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357930 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=647076 CPUtime=49.7 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 14091 1252 0 0 4969 1 0 0 25 0 9 0 655381660 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=647076 CPUtime=49.92 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 20469 1252 0 0 4990 2 0 0 25 0 9 0 655381660 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236995 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23597] ppid=23581 vsize=647076 CPUtime=49.93 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 14995 1252 0 0 4991 2 0 0 25 0 9 0 655381661 662605824 133522 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 400.11
Current children cumulated vsize (KiB) 647076

[startup+102.312 s]
/proc/loadavg: 7.90 7.90 6.89 9/310 23600

################
# More data... #
################

[pid=23583] ppid=23581 vsize=19345032 CPUtime=36258.5 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 45461349 1252 57 0 3616955 8891 0 0 18 0 9 0 655381544 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 4836258 4802664 180 55 0 4834144 0
[pid=23583/tid=23590] ppid=23581 vsize=19345032 CPUtime=4527.47 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5329264 1252 0 0 451711 1036 0 0 25 0 9 0 655381659 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4262955 0 0 4096 17442 0 0 0 -1 5 0 0 57
[pid=23583/tid=23591] ppid=23581 vsize=19345032 CPUtime=4538.34 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5067652 1252 0 0 452828 1006 0 0 25 0 9 0 655381659 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 115
[pid=23583/tid=23592] ppid=23581 vsize=19345032 CPUtime=4526.18 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5124735 1252 0 0 451641 977 0 0 25 0 9 0 655381659 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 4 0 0 233
[pid=23583/tid=23593] ppid=23581 vsize=19345032 CPUtime=4529.61 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 451316 1645 0 0 25 0 9 0 655381659 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=19345032 CPUtime=4538.83 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7042939 1252 0 0 452498 1385 0 0 25 0 9 0 655381660 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23583/tid=23595] ppid=23581 vsize=19345032 CPUtime=4523.4 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5153268 1252 0 0 451369 971 0 0 25 0 9 0 655381660 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 2 0 0 60
[pid=23583/tid=23596] ppid=23581 vsize=19345032 CPUtime=4534.93 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5308286 1252 57 0 452523 970 0 0 25 0 9 0 655381660 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 410
[pid=23583/tid=23597] ppid=23581 vsize=19345032 CPUtime=4538.48 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 4981588 1252 0 0 452958 890 0 0 25 0 9 0 655381661 19809312768 4802664 33554432000 4194304 4417452 140734554181744 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 0 0 0 185
Current children cumulated CPU time (s) 36258.5
Current children cumulated vsize (KiB) 19345032

[startup+4602.3 s]
/proc/loadavg: 8.35 8.23 8.11 9/310 23738
/proc/meminfo: memFree=96944/32950928 swapFree=62006212/67111528
[pid=23583] ppid=23581 vsize=21202092 CPUtime=36726.6 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 46078063 1252 57 0 3663509 9148 0 0 18 0 9 0 655381544 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 5300523 5264720 180 55 0 5298409 0
[pid=23583/tid=23590] ppid=23581 vsize=21202092 CPUtime=4583.47 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5583573 1252 0 0 457205 1142 0 0 25 0 9 0 655381659 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4264911 0 0 4096 17442 0 0 0 -1 4 0 0 432
[pid=23583/tid=23591] ppid=23581 vsize=21202092 CPUtime=4597.18 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5113924 1252 0 0 458687 1031 0 0 25 0 9 0 655381659 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 6 0 0 209
[pid=23583/tid=23592] ppid=23581 vsize=21202092 CPUtime=4585.02 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5196789 1252 0 0 457506 996 0 0 25 0 9 0 655381659 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4250548 0 0 4096 17442 0 0 0 -1 0 0 0 282
[pid=23583/tid=23593] ppid=23581 vsize=21202092 CPUtime=4589.05 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 457260 1645 0 0 25 0 9 0 655381659 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=21202092 CPUtime=4598.03 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7143073 1252 0 0 458378 1425 0 0 25 0 9 0 655381660 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 43
[pid=23583/tid=23595] ppid=23581 vsize=21202092 CPUtime=4582.4 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5178912 1252 0 0 457252 988 0 0 25 0 9 0 655381660 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 119
[pid=23583/tid=23596] ppid=23581 vsize=21202092 CPUtime=4593 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5385690 1252 57 0 458298 1002 0 0 25 0 9 0 655381660 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 1 0 0 540
[pid=23583/tid=23597] ppid=23581 vsize=21202092 CPUtime=4597.22 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 5022485 1252 0 0 458815 907 0 0 25 0 9 0 655381661 21710942208 5264720 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 274
Current children cumulated CPU time (s) 36726.6
Current children cumulated vsize (KiB) 21202092

Solver just ended. Dumping a history of the last processes samples

[startup+4607 s]
/proc/loadavg: 8.33 8.22 8.11 9/310 23738
/proc/meminfo: memFree=99960/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=21333168 CPUtime=36763.7 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 46110832 1252 57 0 3667205 9162 0 0 18 0 9 0 655381544 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 5333292 5297200 180 55 0 5331178 0
[pid=23583/tid=23590] ppid=23581 vsize=21333168 CPUtime=4588.16 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5583573 1252 0 0 457674 1142 0 0 25 0 9 0 655381659 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4320983 0 0 4096 17442 0 0 0 -1 4 0 0 432
[pid=23583/tid=23591] ppid=23581 vsize=21333168 CPUtime=4601.87 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5113924 1252 0 0 459156 1031 0 0 25 0 9 0 655381659 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 209
[pid=23583/tid=23592] ppid=23581 vsize=21333168 CPUtime=4589.57 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5204981 1252 0 0 457955 1002 0 0 25 0 9 0 655381659 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 294
[pid=23583/tid=23593] ppid=23581 vsize=21333168 CPUtime=4593.69 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 457724 1645 0 0 25 0 9 0 655381659 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=21333168 CPUtime=4602.65 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7143073 1252 0 0 458838 1427 0 0 25 0 9 0 655381660 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 43
[pid=23583/tid=23595] ppid=23581 vsize=21333168 CPUtime=4587.09 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5178912 1252 0 0 457721 988 0 0 25 0 9 0 655381660 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 119
[pid=23583/tid=23596] ppid=23581 vsize=21333168 CPUtime=4597.51 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5385690 1252 57 0 458749 1002 0 0 25 0 9 0 655381660 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 1 0 0 540
[pid=23583/tid=23597] ppid=23581 vsize=21333168 CPUtime=4601.91 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 5047062 1252 0 0 459278 913 0 0 25 0 9 0 655381661 21845164032 5297200 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 3 0 0 274
Current children cumulated CPU time (s) 36763.7
Current children cumulated vsize (KiB) 21333168

[startup+4613.41 s]
/proc/loadavg: 8.30 8.22 8.11 9/310 23738
/proc/meminfo: memFree=596632/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=20837028 CPUtime=36814.9 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 46129236 1252 57 0 3672321 9168 0 0 18 0 9 0 655381544 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 5209257 5173165 180 55 0 5207143 0
[pid=23583/tid=23590] ppid=23581 vsize=20837028 CPUtime=4594.57 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5583573 1252 0 0 458315 1142 0 0 25 0 9 0 655381659 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 432
[pid=23583/tid=23591] ppid=23581 vsize=20837028 CPUtime=4608.28 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5113924 1252 0 0 459797 1031 0 0 25 0 9 0 655381659 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 209
[pid=23583/tid=23592] ppid=23581 vsize=20837028 CPUtime=4595.98 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5205011 1252 0 0 458596 1002 0 0 25 0 9 0 655381659 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 2 0 0 294
[pid=23583/tid=23593] ppid=23581 vsize=20837028 CPUtime=4600.04 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 458359 1645 0 0 25 0 9 0 655381659 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364749 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=20837028 CPUtime=4609.06 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7143073 1252 0 0 459479 1427 0 0 25 0 9 0 655381660 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 0 0 0 43
[pid=23583/tid=23595] ppid=23581 vsize=20837028 CPUtime=4593.5 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5178912 1252 0 0 458362 988 0 0 25 0 9 0 655381660 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 119
[pid=23583/tid=23596] ppid=23581 vsize=20837028 CPUtime=4603.92 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5404064 1252 57 0 459384 1008 0 0 25 0 9 0 655381660 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4263070 0 0 4096 17442 0 0 0 -1 1 0 0 540
[pid=23583/tid=23597] ppid=23581 vsize=20837028 CPUtime=4608.32 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 5047062 1252 0 0 459919 913 0 0 25 0 9 0 655381661 21337116672 5173165 33554432000 4194304 4417452 140734554181744 18446744073709551615 4250927 0 0 4096 17442 0 0 0 -1 3 0 0 274
Current children cumulated CPU time (s) 36814.9
Current children cumulated vsize (KiB) 20837028

[startup+4616.6 s]
/proc/loadavg: 8.27 8.22 8.11 9/310 23738
/proc/meminfo: memFree=401516/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=21033064 CPUtime=36840.4 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 46178245 1252 57 0 3674866 9177 0 0 18 0 9 0 655381544 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 5258266 5222174 180 55 0 5256152 0
[pid=23583/tid=23590] ppid=23581 vsize=21033064 CPUtime=4597.77 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5583573 1252 0 0 458635 1142 0 0 25 0 9 0 655381659 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357552 0 0 4096 17442 0 0 0 -1 4 0 0 432
[pid=23583/tid=23591] ppid=23581 vsize=21033064 CPUtime=4611.48 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5113924 1252 0 0 460117 1031 0 0 25 0 9 0 655381659 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 209
[pid=23583/tid=23592] ppid=23581 vsize=21033064 CPUtime=4599.18 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5226198 1252 0 0 458909 1009 0 0 25 0 9 0 655381659 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 294
[pid=23583/tid=23593] ppid=23581 vsize=21033064 CPUtime=4603.2 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 458675 1645 0 0 25 0 9 0 655381659 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=21033064 CPUtime=4612.25 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7169239 1252 0 0 459796 1429 0 0 25 0 9 0 655381660 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 43
[pid=23583/tid=23595] ppid=23581 vsize=21033064 CPUtime=4596.7 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5178912 1252 0 0 458682 988 0 0 25 0 9 0 655381660 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 119
[pid=23583/tid=23596] ppid=23581 vsize=21033064 CPUtime=4607.12 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5405720 1252 57 0 459704 1008 0 0 25 0 9 0 655381660 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4262948 0 0 4096 17442 0 0 0 -1 1 0 0 540
[pid=23583/tid=23597] ppid=23581 vsize=21033064 CPUtime=4611.52 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 5047062 1252 0 0 460239 913 0 0 25 0 9 0 655381661 21537857536 5222174 33554432000 4194304 4417452 140734554181744 18446744073709551615 4236593 0 0 4096 17442 0 0 0 -1 3 0 0 274
Current children cumulated CPU time (s) 36840.4
Current children cumulated vsize (KiB) 21033064

[startup+4617.4 s]
/proc/loadavg: 8.27 8.22 8.11 9/310 23738
/proc/meminfo: memFree=401516/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=21035876 CPUtime=36846.8 cores=0-7
/proc/23583/stat : 23583 (plingeling) S 23581 23583 23439 0 -1 4202496 46178948 1252 57 0 3675500 9177 0 0 18 0 9 0 655381544 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 5258969 5222877 180 55 0 5256855 0
[pid=23583/tid=23590] ppid=23581 vsize=21035876 CPUtime=4598.56 cores=0-7
/proc/23583/task/23590/stat : 23590 (plingeling) R 23581 23583 23439 0 -1 4202560 5583573 1252 0 0 458714 1142 0 0 25 0 9 0 655381659 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 432
[pid=23583/tid=23591] ppid=23581 vsize=21035876 CPUtime=4612.27 cores=0-7
/proc/23583/task/23591/stat : 23591 (plingeling) R 23581 23583 23439 0 -1 4202560 5113924 1252 0 0 460196 1031 0 0 25 0 9 0 655381659 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 209
[pid=23583/tid=23592] ppid=23581 vsize=21035876 CPUtime=4599.97 cores=0-7
/proc/23583/task/23592/stat : 23592 (plingeling) R 23581 23583 23439 0 -1 4202560 5226198 1252 0 0 458988 1009 0 0 25 0 9 0 655381659 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 2 0 0 294
[pid=23583/tid=23593] ppid=23581 vsize=21035876 CPUtime=4603.99 cores=0-7
/proc/23583/task/23593/stat : 23593 (plingeling) R 23581 23583 23439 0 -1 4202560 7395505 1252 0 0 458754 1645 0 0 25 0 9 0 655381659 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 7 0 0 471
[pid=23583/tid=23594] ppid=23581 vsize=21035876 CPUtime=4613.04 cores=0-7
/proc/23583/task/23594/stat : 23594 (plingeling) R 23581 23583 23439 0 -1 4202560 7169239 1252 0 0 459875 1429 0 0 25 0 9 0 655381660 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 0 0 0 43
[pid=23583/tid=23595] ppid=23581 vsize=21035876 CPUtime=4597.49 cores=0-7
/proc/23583/task/23595/stat : 23595 (plingeling) R 23581 23583 23439 0 -1 4202560 5178912 1252 0 0 458761 988 0 0 25 0 9 0 655381660 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4357589 0 0 4096 17442 0 0 0 -1 5 0 0 119
[pid=23583/tid=23596] ppid=23581 vsize=21035876 CPUtime=4607.91 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4202560 5406423 1252 57 0 459783 1008 0 0 25 0 9 0 655381660 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 1 0 0 540
[pid=23583/tid=23597] ppid=23581 vsize=21035876 CPUtime=4612.31 cores=0-7
/proc/23583/task/23597/stat : 23597 (plingeling) R 23581 23583 23439 0 -1 4202560 5047062 1252 0 0 460318 913 0 0 25 0 9 0 655381661 21540737024 5222877 33554432000 4194304 4417452 140734554181744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 274
Current children cumulated CPU time (s) 36846.8
Current children cumulated vsize (KiB) 21035876

[startup+4618.2 s]
/proc/loadavg: 8.27 8.22 8.11 2/303 23738
/proc/meminfo: memFree=2328368/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=0 CPUtime=36849 cores=0-7
/proc/23583/stat : 23583 (plingeling) Z 23581 23583 23439 0 -1 4203548 46178959 1252 57 0 3675665 9236 0 0 18 0 2 0 655381544 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 0 0 0 0 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=0 CPUtime=4608.72 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4203588 5406423 1252 57 0 459804 1068 0 0 25 0 2 0 655381660 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 -1 1 0 0 540
Current children cumulated CPU time (s) 36849
Current children cumulated vsize (KiB) 0

[startup+4618.4 s]
/proc/loadavg: 8.27 8.22 8.11 2/303 23738
/proc/meminfo: memFree=2328368/32950928 swapFree=61863640/67111528
[pid=23583] ppid=23581 vsize=0 CPUtime=36849.2 cores=0-7
/proc/23583/stat : 23583 (plingeling) Z 23581 23583 23439 0 -1 4203548 46178959 1252 57 0 3675665 9256 0 0 18 0 2 0 655381544 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/23583/statm: 0 0 0 0 0 0 0
[pid=23583/tid=23596] ppid=23581 vsize=0 CPUtime=4608.92 cores=0-7
/proc/23583/task/23596/stat : 23596 (plingeling) R 23581 23583 23439 0 -1 4203588 5406423 1252 57 0 459804 1088 0 0 25 0 2 0 655381660 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 -1 1 0 0 540
Current children cumulated CPU time (s) 36849.2
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 4618.5
CPU time (s): 36849.3
CPU user time (s): 36756.7
CPU system time (s): 92.6689
CPU usage (%): 797.863
Max. virtual memory (cumulated for all children) (KiB): 21333168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 36756.7
system time used= 92.6689
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 46180211
page faults= 57
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1890
involuntary context switches= 176182

runsolver used 13.5049 second user time and 32.601 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-15 07:37:08
IDJOB=3372458
IDBENCH=82392
IDSOLVER=1851
FILE ID=node120/3372458-1305437827
RUNJOBID= node120-1305436403-23453
PBS_JOBID= 13324749
Free space on /tmp= 73632 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372458-1305437827/watcher-3372458-1305437827 -o /tmp/evaluation-result-3372458-1305437827/solver-3372458-1305437827 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372458-1305437827.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 28233bedeee44da6e79e63b9febc4d1e
RANDOM SEED=144157549

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14531452 kB
Buffers:        229464 kB
Cached:        1409284 kB
SwapCached:          0 kB
Active:       16630816 kB
Inactive:      1511548 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14531452 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           12088 kB
Writeback:          24 kB
AnonPages:    16503820 kB
Mapped:          24452 kB
Slab:           165592 kB
PageTables:      48408 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 51548740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73632 MiB
End job on node120 at 2011-05-15 08:54:06