Trace number 3372191

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 10551.1 1326.97

General information on the benchmark

Namevelev-vliw-uns-4.0-9-i1.cnf
MD5SUM590cca3a58efdeb1c95ef988a53daa1d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark380.915
Satisfiable
(Un)Satisfiability was proved
Number of variables154309
Number of clauses3230738
Sum of the clauses size9429252
Maximum clause length3625
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 22024994
Number of clauses of size 31081436
Number of clauses of size 48866
Number of clauses of size 58692
Number of clauses of size over 5106749

Solver Data 

10551.01/1326.96	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372191-1305436498/watcher-3372191-1305436498 -o /tmp/evaluation-result-3372191-1305436498/solver-3372191-1305436498 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372191-1305436498.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.14 2.53 2.99 1/301 23507
/proc/meminfo: memFree=14473816/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=11220 CPUtime=0 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 882 1260 0 0 0 0 0 0 21 0 1 0 655248786 11489280 812 33554432000 4194304 4417452 140734961507312 18446744073709551615 235594866432 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 2805 812 148 55 0 691 0

[startup+0.0803239 s]
/proc/loadavg: 3.14 2.53 2.99 1/301 23507
/proc/meminfo: memFree=14473816/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=26516 CPUtime=0.06 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 4723 1260 0 0 6 0 0 0 22 0 1 0 655248786 27152384 4653 33554432000 4194304 4417452 140734961507312 18446744073709551615 235594485226 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 6629 4653 149 55 0 4515 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 26516

[startup+0.10031 s]
/proc/loadavg: 3.14 2.53 2.99 1/301 23507
/proc/meminfo: memFree=14473816/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=31016 CPUtime=0.08 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 5848 1260 0 0 8 0 0 0 22 0 1 0 655248786 31760384 5778 33554432000 4194304 4417452 140734961507312 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 7754 5778 149 55 0 5640 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 31016

[startup+0.300275 s]
/proc/loadavg: 3.14 2.53 2.99 1/301 23507
/proc/meminfo: memFree=14473816/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=70860 CPUtime=0.29 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 15906 1260 0 0 27 2 0 0 22 0 1 0 655248786 72560640 15677 33554432000 4194304 4417452 140734961507312 18446744073709551615 235594560605 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 17715 15701 149 55 0 15601 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 70860

[startup+0.700203 s]
/proc/loadavg: 3.14 2.53 2.99 1/301 23507
/proc/meminfo: memFree=14473816/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=130748 CPUtime=0.69 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 30952 1260 0 0 65 4 0 0 25 0 1 0 655248786 133885952 30711 33554432000 4194304 4417452 140734961507312 18446744073709551615 4262041 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 32687 30711 149 55 0 30573 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 130748

[startup+1.50106 s]
/proc/loadavg: 3.14 2.53 2.99 2/302 23513
/proc/meminfo: memFree=14351180/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=212668 CPUtime=1.49 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 51432 1260 0 0 142 7 0 0 25 0 1 0 655248786 217772032 51191 33554432000 4194304 4417452 140734961507312 18446744073709551615 235594866432 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 53167 51191 149 55 0 51053 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 212668

[startup+3.10078 s]
/proc/loadavg: 3.14 2.53 2.99 2/302 23513
/proc/meminfo: memFree=14198288/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=414152 CPUtime=3.09 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 101803 1260 0 0 296 13 0 0 25 0 1 0 655248786 424091648 101562 33554432000 4194304 4417452 140734961507312 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 103538 101562 149 55 0 101424 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 414152

[startup+6.30022 s]
/proc/loadavg: 2.97 2.51 2.98 2/302 23514
/proc/meminfo: memFree=13665628/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=816176 CPUtime=6.29 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 202350 1260 0 0 604 25 0 0 25 0 1 0 655248786 835764224 202068 33554432000 4194304 4417452 140734961507312 18446744073709551615 4235968 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/23507/statm: 204044 202068 149 55 0 201930 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 816176

[startup+12.7011 s]
/proc/loadavg: 3.37 2.60 3.00 9/310 23522
/proc/meminfo: memFree=13437436/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1059284 CPUtime=51.25 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 484719 1260 0 0 5053 72 0 0 18 0 9 0 655248786 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 264821 235076 177 55 0 262707 0
[pid=23507/tid=23515] ppid=23505 vsize=1059284 CPUtime=5.52 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 35477 1260 0 0 547 5 0 0 25 0 9 0 655249501 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=1059284 CPUtime=5.53 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 49661 1260 0 0 545 8 0 0 25 0 9 0 655249501 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4255595 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=1059284 CPUtime=5.42 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 22422 1260 0 0 539 3 0 0 25 0 9 0 655249501 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=1059284 CPUtime=5.48 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 3784 1260 0 0 548 0 0 0 25 0 9 0 655249501 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232615 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=1059284 CPUtime=5.53 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 35562 1260 0 0 548 5 0 0 25 0 9 0 655249501 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4270966 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=1059284 CPUtime=5.51 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 56785 1260 0 0 541 10 0 0 25 0 9 0 655249502 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4256060 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=1059284 CPUtime=5.52 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 41091 1260 0 0 546 6 0 0 25 0 9 0 655249503 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4301955 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=1059284 CPUtime=5.52 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 37570 1260 0 0 546 6 0 0 25 0 9 0 655249503 1084706816 235076 33554432000 4194304 4417452 140734961507312 18446744073709551615 4234224 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 51.25
Current children cumulated vsize (KiB) 1059284

[startup+25.5008 s]
/proc/loadavg: 4.40 2.86 3.08 9/310 23522
/proc/meminfo: memFree=13176788/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1435584 CPUtime=153.43 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 683464 1260 0 0 15229 114 0 0 18 0 9 0 655248786 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 358896 324070 180 55 0 356782 0
[pid=23507/tid=23515] ppid=23505 vsize=1435584 CPUtime=18.27 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 70400 1260 0 0 1818 9 0 0 25 0 9 0 655249501 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232595 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=1435584 CPUtime=18.32 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 69222 1260 0 0 1818 14 0 0 25 0 9 0 655249501 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=1435584 CPUtime=18.22 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 55489 1260 0 0 1809 13 0 0 25 0 9 0 655249501 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=1435584 CPUtime=18.15 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 3784 1260 0 0 1815 0 0 0 25 0 9 0 655249501 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=1435584 CPUtime=18.32 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 70486 1260 0 0 1819 13 0 0 25 0 9 0 655249501 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365552 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=1435584 CPUtime=18.31 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 78369 1260 0 0 1818 13 0 0 25 0 9 0 655249502 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=1435584 CPUtime=18.31 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 59281 1260 0 0 1820 11 0 0 25 0 9 0 655249503 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=1435584 CPUtime=18.3 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 74066 1260 0 0 1820 10 0 0 25 0 9 0 655249503 1470038016 324070 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 153.43
Current children cumulated vsize (KiB) 1435584

[startup+51.1013 s]
/proc/loadavg: 5.63 3.27 3.21 9/310 23523
/proc/meminfo: memFree=13113152/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1502024 CPUtime=357.96 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 700106 1260 0 0 35680 116 0 0 18 0 9 0 655248786 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 375506 340680 180 55 0 373392 0
[pid=23507/tid=23515] ppid=23505 vsize=1502024 CPUtime=43.87 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 70400 1260 0 0 4378 9 0 0 25 0 9 0 655249501 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=1502024 CPUtime=43.92 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 69348 1260 0 0 4378 14 0 0 25 0 9 0 655249501 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4237214 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=1502024 CPUtime=43.82 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 55489 1260 0 0 4369 13 0 0 25 0 9 0 655249501 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=1502024 CPUtime=43.5 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 20168 1260 0 0 4348 2 0 0 25 0 9 0 655249501 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=1502024 CPUtime=43.92 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 70486 1260 0 0 4379 13 0 0 25 0 9 0 655249501 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=1502024 CPUtime=43.91 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 78369 1260 0 0 4378 13 0 0 25 0 9 0 655249502 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=1502024 CPUtime=43.88 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 59413 1260 0 0 4377 11 0 0 25 0 9 0 655249503 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4277594 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=1502024 CPUtime=43.9 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 74066 1260 0 0 4380 10 0 0 25 0 9 0 655249503 1538072576 340680 33554432000 4194304 4417452 140734961507312 18446744073709551615 4353636 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 357.96
Current children cumulated vsize (KiB) 1502024

[startup+102.312 s]
/proc/loadavg: 7.05 4.07 3.48 9/310 23524
/proc/meminfo: memFree=13085932/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1525064 CPUtime=767.1 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 1043634 1260 0 0 76512 198 0 0 18 0 9 0 655248786 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 381266 346295 180 55 0 379152 0
[pid=23507/tid=23515] ppid=23505 vsize=1525064 CPUtime=95.09 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 116874 1260 0 0 9489 20 0 0 25 0 9 0 655249501 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=1525064 CPUtime=95.13 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 117956 1260 0 0 9487 26 0 0 25 0 9 0 655249501 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=1525064 CPUtime=95.02 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 103804 1260 0 0 9477 25 0 0 25 0 9 0 655249501 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=1525064 CPUtime=94.2 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 20168 1260 0 0 9418 2 0 0 25 0 9 0 655249501 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=1525064 CPUtime=95.11 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 122046 1260 0 0 9486 25 0 0 25 0 9 0 655249501 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=1525064 CPUtime=95.11 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 125545 1260 0 0 9487 24 0 0 25 0 9 0 655249502 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=1525064 CPUtime=95.09 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 107740 1260 0 0 9487 22 0 0 25 0 9 0 655249503 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4275606 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=1525064 CPUtime=95.11 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 127134 1260 0 0 9489 22 0 0 25 0 9 0 655249503 1561665536 346295 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236812 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 767.1
Current children cumulated vsize (KiB) 1525064

[startup+162.301 s]
/proc/loadavg: 7.66 4.74 3.75 9/310 23526
/proc/meminfo: memFree=13110428/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1504092 CPUtime=1246.38 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 1328359 1260 0 0 124403 235 0 0 18 0 9 0 655248786 1540190208 341058 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 376023 341058 180 55 0 373909 0
[pid=23507/tid=23515] ppid=23505 vsize=1504092 CPUtime=155.08 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 157630 1260 0 0 15483 25 0 0 25 0 9 0 655249501 1540190208 341058 33554432000 4194304 4417452 140734961507312 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=1504092 CPUtime=155.12 cores=0-7

################
# More data... #
################

/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 129433 80 0 0 25 0 9 0 655249501 2228060160 509001 33554432000 4194304 4417452 140734961507312 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2175840 CPUtime=1295.12 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501333 1260 0 0 129438 74 0 0 25 0 9 0 655249502 2228060160 509001 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2175840 CPUtime=1294.92 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 552416 1260 0 0 129412 80 0 0 25 0 9 0 655249503 2228060160 509001 33554432000 4194304 4417452 140734961507312 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2175840 CPUtime=1295.12 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 483064 1260 0 0 129443 69 0 0 25 0 9 0 655249503 2228060160 509001 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10354.9
Current children cumulated vsize (KiB) 2175840

Solver just ended. Dumping a history of the last processes samples

[startup+1305.5 s]
/proc/loadavg: 8.03 7.98 6.78 9/310 23556
/proc/meminfo: memFree=12430876/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2179728 CPUtime=10380.4 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4105071 1260 0 0 1037437 606 0 0 18 0 9 0 655248786 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 544932 509973 180 55 0 542818 0
[pid=23507/tid=23515] ppid=23505 vsize=2179728 CPUtime=1298.28 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 129757 71 0 0 25 0 9 0 655249501 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2179728 CPUtime=1298.29 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 570587 1260 0 0 129744 85 0 0 25 0 9 0 655249501 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2179728 CPUtime=1298.21 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 129744 77 0 0 25 0 9 0 655249501 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2179728 CPUtime=1285.38 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 230806 1260 0 0 128498 40 0 0 25 0 9 0 655249501 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2179728 CPUtime=1298.32 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 129752 80 0 0 25 0 9 0 655249501 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2179728 CPUtime=1298.31 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501333 1260 0 0 129757 74 0 0 25 0 9 0 655249502 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365962 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2179728 CPUtime=1298.11 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 552416 1260 0 0 129731 80 0 0 25 0 9 0 655249503 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4262537 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2179728 CPUtime=1298.3 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 483064 1260 0 0 129761 69 0 0 25 0 9 0 655249503 2232041472 509973 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10380.4
Current children cumulated vsize (KiB) 2179728

[startup+1318.3 s]
/proc/loadavg: 8.02 7.98 6.79 9/310 23557
/proc/meminfo: memFree=12397520/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2214104 CPUtime=10482.7 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4113670 1260 0 0 1047663 607 0 0 18 0 9 0 655248786 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 553526 518567 180 55 0 551412 0
[pid=23507/tid=23515] ppid=23505 vsize=2214104 CPUtime=1311.08 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 131037 71 0 0 25 0 9 0 655249501 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2214104 CPUtime=1311.09 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 573510 1260 0 0 131023 86 0 0 25 0 9 0 655249501 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2214104 CPUtime=1311.02 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 131025 77 0 0 25 0 9 0 655249501 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2214104 CPUtime=1298.05 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 230806 1260 0 0 129765 40 0 0 25 0 9 0 655249501 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2214104 CPUtime=1311.12 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 131032 80 0 0 25 0 9 0 655249501 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2214104 CPUtime=1311.11 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501333 1260 0 0 131037 74 0 0 25 0 9 0 655249502 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236693 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2214104 CPUtime=1310.91 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 555272 1260 0 0 131011 80 0 0 25 0 9 0 655249503 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4263027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2214104 CPUtime=1311.1 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 485884 1260 0 0 131041 69 0 0 25 0 9 0 655249503 2267242496 518567 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10482.7
Current children cumulated vsize (KiB) 2214104

[startup+1321.5 s]
/proc/loadavg: 8.02 7.98 6.79 9/310 23557
/proc/meminfo: memFree=12385988/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2225620 CPUtime=10508.3 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4116549 1260 0 0 1050219 607 0 0 18 0 9 0 655248786 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 556405 521446 180 55 0 554291 0
[pid=23507/tid=23515] ppid=23505 vsize=2225620 CPUtime=1314.28 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 131357 71 0 0 25 0 9 0 655249501 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365545 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2225620 CPUtime=1314.29 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 573510 1260 0 0 131343 86 0 0 25 0 9 0 655249501 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4365135 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2225620 CPUtime=1314.22 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 131345 77 0 0 25 0 9 0 655249501 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2225620 CPUtime=1301.22 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 230806 1260 0 0 130082 40 0 0 25 0 9 0 655249501 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232791 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2225620 CPUtime=1314.32 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 131352 80 0 0 25 0 9 0 655249501 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2225620 CPUtime=1314.31 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501333 1260 0 0 131357 74 0 0 25 0 9 0 655249502 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2225620 CPUtime=1314.11 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 555272 1260 0 0 131331 80 0 0 25 0 9 0 655249503 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2225620 CPUtime=1314.3 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 488763 1260 0 0 131361 69 0 0 25 0 9 0 655249503 2279034880 521446 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10508.3
Current children cumulated vsize (KiB) 2225620

[startup+1324.7 s]
/proc/loadavg: 8.02 7.98 6.80 9/310 23557
/proc/meminfo: memFree=12547932/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2064592 CPUtime=10533.8 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4119461 1260 0 0 1052775 608 0 0 18 0 9 0 655248786 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 516148 481189 180 55 0 514034 0
[pid=23507/tid=23515] ppid=23505 vsize=2064592 CPUtime=1317.48 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 131677 71 0 0 25 0 9 0 655249501 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236630 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2064592 CPUtime=1317.49 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 573510 1260 0 0 131663 86 0 0 25 0 9 0 655249501 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2064592 CPUtime=1317.42 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 131665 77 0 0 25 0 9 0 655249501 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2064592 CPUtime=1304.39 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 233718 1260 0 0 130398 41 0 0 25 0 9 0 655249501 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2064592 CPUtime=1317.52 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 131672 80 0 0 25 0 9 0 655249501 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2064592 CPUtime=1317.51 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501333 1260 0 0 131677 74 0 0 25 0 9 0 655249502 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2064592 CPUtime=1317.31 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 555272 1260 0 0 131651 80 0 0 25 0 9 0 655249503 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4250795 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2064592 CPUtime=1317.5 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 488763 1260 0 0 131681 69 0 0 25 0 9 0 655249503 2114142208 481189 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10533.8
Current children cumulated vsize (KiB) 2064592

[startup+1326.3 s]
/proc/loadavg: 8.02 7.98 6.80 9/310 23557
/proc/meminfo: memFree=12547436/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2065876 CPUtime=10546.6 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4119811 1260 0 0 1054054 608 0 0 18 0 9 0 655248786 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 516469 481510 180 55 0 514355 0
[pid=23507/tid=23515] ppid=23505 vsize=2065876 CPUtime=1319.08 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 131837 71 0 0 25 0 9 0 655249501 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2065876 CPUtime=1319.09 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 573510 1260 0 0 131823 86 0 0 25 0 9 0 655249501 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4357204 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2065876 CPUtime=1319.02 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 131825 77 0 0 25 0 9 0 655249501 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2065876 CPUtime=1305.98 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 234009 1260 0 0 130557 41 0 0 25 0 9 0 655249501 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364420 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2065876 CPUtime=1319.12 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 131832 80 0 0 25 0 9 0 655249501 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4284943 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2065876 CPUtime=1319.11 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501392 1260 0 0 131837 74 0 0 25 0 9 0 655249502 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4265418 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2065876 CPUtime=1318.91 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 555272 1260 0 0 131811 80 0 0 25 0 9 0 655249503 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4281863 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2065876 CPUtime=1319.1 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 488763 1260 0 0 131841 69 0 0 25 0 9 0 655249503 2115457024 481510 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10546.6
Current children cumulated vsize (KiB) 2065876

[startup+1326.7 s]
/proc/loadavg: 8.02 7.98 6.80 9/310 23557
/proc/meminfo: memFree=12546444/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=2066192 CPUtime=10549.8 cores=0-7
/proc/23507/stat : 23507 (plingeling) S 23505 23507 23439 0 -1 4202496 4119890 1260 0 0 1054373 608 0 0 18 0 9 0 655248786 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/23507/statm: 516548 481589 180 55 0 514434 0
[pid=23507/tid=23515] ppid=23505 vsize=2066192 CPUtime=1319.48 cores=0-7
/proc/23507/task/23515/stat : 23515 (plingeling) R 23505 23507 23439 0 -1 4202560 505918 1260 0 0 131877 71 0 0 25 0 9 0 655249501 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232317 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=23507/tid=23516] ppid=23505 vsize=2066192 CPUtime=1319.49 cores=0-7
/proc/23507/task/23516/stat : 23516 (plingeling) R 23505 23507 23439 0 -1 4202560 573510 1260 0 0 131863 86 0 0 25 0 9 0 655249501 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23507/tid=23517] ppid=23505 vsize=2066192 CPUtime=1319.42 cores=0-7
/proc/23507/task/23517/stat : 23517 (plingeling) R 23505 23507 23439 0 -1 4202560 505959 1260 0 0 131865 77 0 0 25 0 9 0 655249501 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=23507/tid=23518] ppid=23505 vsize=2066192 CPUtime=1306.37 cores=0-7
/proc/23507/task/23518/stat : 23518 (plingeling) R 23505 23507 23439 0 -1 4202560 234088 1260 0 0 130596 41 0 0 25 0 9 0 655249501 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=23507/tid=23519] ppid=23505 vsize=2066192 CPUtime=1319.52 cores=0-7
/proc/23507/task/23519/stat : 23519 (plingeling) R 23505 23507 23439 0 -1 4202560 552621 1260 0 0 131872 80 0 0 25 0 9 0 655249501 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4310180 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23507/tid=23520] ppid=23505 vsize=2066192 CPUtime=1319.51 cores=0-7
/proc/23507/task/23520/stat : 23520 (plingeling) R 23505 23507 23439 0 -1 4202560 501392 1260 0 0 131877 74 0 0 25 0 9 0 655249502 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4281907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=23507/tid=23521] ppid=23505 vsize=2066192 CPUtime=1319.31 cores=0-7
/proc/23507/task/23521/stat : 23521 (plingeling) R 23505 23507 23439 0 -1 4202560 555272 1260 0 0 131851 80 0 0 25 0 9 0 655249503 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4259140 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=23507/tid=23522] ppid=23505 vsize=2066192 CPUtime=1319.5 cores=0-7
/proc/23507/task/23522/stat : 23522 (plingeling) R 23505 23507 23439 0 -1 4202560 488763 1260 0 0 131881 69 0 0 25 0 9 0 655249503 2115780608 481589 33554432000 4194304 4417452 140734961507312 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10549.8
Current children cumulated vsize (KiB) 2066192

[startup+1326.9 s]
/proc/loadavg: 8.02 7.98 6.80 9/310 23557
/proc/meminfo: memFree=12546444/32950928 swapFree=67111348/67111528
[pid=23507] ppid=23505 vsize=1584420 CPUtime=10551 cores=0-7
/proc/23507/stat : 23507 (plingeling) R 23505 23507 23439 0 -1 4202496 4119891 1260 0 0 1054491 610 0 0 18 0 1 0 655248786 1622446080 372228 33554432000 4194304 4417452 140734961507312 18446744073709551615 235594909831 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23507/statm: 396105 372228 181 55 0 393991 0
Current children cumulated CPU time (s) 10551
Current children cumulated vsize (KiB) 1584420

Child status: 20
Real time (s): 1326.97
CPU time (s): 10551.1
CPU user time (s): 10544.9
CPU system time (s): 6.17506
CPU usage (%): 795.126
Max. virtual memory (cumulated for all children) (KiB): 2225620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10544.9
system time used= 6.17506
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4121154
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 433
involuntary context switches= 50699

runsolver used 3.85541 second user time and 9.40257 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-15 07:15:00
IDJOB=3372191
IDBENCH=69571
IDSOLVER=1851
FILE ID=node120/3372191-1305436498
RUNJOBID= node120-1305436403-23453
PBS_JOBID= 13324749
Free space on /tmp= 73580 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT_RACE08/cnf/velev-vliw-uns-4.0-9-i1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372191-1305436498/watcher-3372191-1305436498 -o /tmp/evaluation-result-3372191-1305436498/solver-3372191-1305436498 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372191-1305436498.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 590cca3a58efdeb1c95ef988a53daa1d
RANDOM SEED=2136064297

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14474096 kB
Buffers:        229268 kB
Cached:        1463668 kB
SwapCached:          0 kB
Active:       16686872 kB
Inactive:      1509912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14474096 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           68788 kB
Writeback:           0 kB
AnonPages:    16503604 kB
Mapped:          24192 kB
Slab:           167544 kB
PageTables:      48172 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 51547816 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73576 MiB
End job on node120 at 2011-05-15 07:37:07