Trace number 3394466

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.7 5003.93

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-9x32.cnf
MD5SUMbcc12436eba65ad776b55f23c6f42298
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1152
Number of clauses73440
Sum of the clauses size290304
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21728
Number of clauses of size 30
Number of clauses of size 471712
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394466-1307665452/watcher-3394466-1307665452 -o /tmp/evaluation-result-3394466-1307665452/solver-3394466-1307665452 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394466-1307665452.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.16 1.75 1.90 2/171 24877
/proc/meminfo: memFree=32090760/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=10112 CPUtime=0 cores=0-7
/proc/24877/stat : 24877 (plingeling) R 24875 24877 24694 0 -1 4202496 613 1260 0 0 0 0 0 0 25 0 1 0 878143416 10354688 544 33554432000 4194304 4417452 140736876743408 18446744073709551615 232335589131 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/24877/statm: 2562 552 147 55 0 448 0

[startup+0.077225 s]
/proc/loadavg: 1.16 1.75 1.90 2/171 24877
/proc/meminfo: memFree=32090760/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=26600 CPUtime=0.06 cores=0-7
/proc/24877/stat : 24877 (plingeling) R 24875 24877 24694 0 -1 4202496 4991 1260 0 0 6 0 0 0 25 0 1 0 878143416 27238400 4673 33554432000 4194304 4417452 140736876743408 18446744073709551615 4231468 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/24877/statm: 6650 4673 148 55 0 4536 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 26600

[startup+0.100221 s]
/proc/loadavg: 1.16 1.75 1.90 2/171 24877
/proc/meminfo: memFree=32090760/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=34792 CPUtime=0.08 cores=0-7
/proc/24877/stat : 24877 (plingeling) R 24875 24877 24694 0 -1 4202496 7039 1260 0 0 8 0 0 0 25 0 1 0 878143416 35627008 6721 33554432000 4194304 4417452 140736876743408 18446744073709551615 4231554 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/24877/statm: 8698 6721 148 55 0 6584 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 34792

[startup+0.300151 s]
/proc/loadavg: 1.16 1.75 1.90 2/171 24877
/proc/meminfo: memFree=32090760/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=195172 CPUtime=1.22 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 11871 1260 0 0 121 1 0 0 25 0 9 0 878143416 199856128 9997 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 48793 9997 178 55 0 46679 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 195172

[startup+0.701075 s]
/proc/loadavg: 1.16 1.75 1.90 2/171 24877
/proc/meminfo: memFree=32090760/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=214780 CPUtime=4.43 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17862 1260 0 0 441 2 0 0 25 0 9 0 878143416 219934720 14879 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 53695 14879 180 55 0 51581 0
Current children cumulated CPU time (s) 4.43
Current children cumulated vsize (KiB) 214780

[startup+1.50093 s]
/proc/loadavg: 1.16 1.75 1.90 9/180 24891
/proc/meminfo: memFree=32012592/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=236276 CPUtime=10.82 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 25452 1260 0 0 1079 3 0 0 25 0 9 0 878143416 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 59069 20253 180 55 0 56955 0
[pid=24877/tid=24884] ppid=24875 vsize=236276 CPUtime=1.33 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1709 1260 0 0 133 0 0 0 19 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4258329 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=236276 CPUtime=1.33 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 1697 1260 0 0 133 0 0 0 19 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249378 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=236276 CPUtime=1.33 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 1578 1260 0 0 133 0 0 0 19 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=236276 CPUtime=1.32 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 4759 1260 0 0 132 0 0 0 25 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=236276 CPUtime=1.33 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 1665 1260 0 0 133 0 0 0 18 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4250072 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=236276 CPUtime=1.33 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 1675 1260 0 0 133 0 0 0 25 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=236276 CPUtime=1.32 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 1578 1260 0 0 132 0 0 0 25 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=236276 CPUtime=1.31 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 1688 1260 0 0 131 0 0 0 25 0 9 0 878143432 241946624 20253 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.82
Current children cumulated vsize (KiB) 236276

[startup+3.10065 s]
/proc/loadavg: 1.16 1.75 1.90 9/180 24891
/proc/meminfo: memFree=32006268/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=253916 CPUtime=23.61 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 49305 1260 0 0 2353 8 0 0 25 0 9 0 878143416 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 63479 24679 180 55 0 61365 0
[pid=24877/tid=24884] ppid=24875 vsize=253916 CPUtime=2.93 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 2882 1260 0 0 293 0 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=253916 CPUtime=2.92 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 5035 1260 0 0 292 0 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=253916 CPUtime=2.93 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 7353 1260 0 0 292 1 0 0 24 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249022 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=253916 CPUtime=2.93 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 7454 1260 0 0 292 1 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=253916 CPUtime=2.92 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 3384 1260 0 0 292 0 0 0 21 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=253916 CPUtime=2.92 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 4412 1260 0 0 292 0 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4250640 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=253916 CPUtime=2.91 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 6656 1260 0 0 290 1 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=253916 CPUtime=2.91 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 3026 1260 0 0 291 0 0 0 25 0 9 0 878143432 260009984 24679 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.61
Current children cumulated vsize (KiB) 253916

[startup+6.30108 s]
/proc/loadavg: 1.70 1.85 1.93 9/180 24891
/proc/meminfo: memFree=31971796/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=299704 CPUtime=49.19 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 86778 1260 0 0 4903 16 0 0 25 0 9 0 878143416 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 74926 36126 180 55 0 72812 0
[pid=24877/tid=24884] ppid=24875 vsize=299704 CPUtime=6.13 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 8164 1260 0 0 612 1 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=299704 CPUtime=6.13 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 6221 1260 0 0 612 1 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=299704 CPUtime=6.13 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 16924 1260 0 0 610 3 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=299704 CPUtime=6.12 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 12385 1260 0 0 610 2 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=299704 CPUtime=6.12 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 4844 1260 0 0 612 0 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=299704 CPUtime=6.13 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 11079 1260 0 0 611 2 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=299704 CPUtime=6.1 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 12868 1260 0 0 608 2 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=299704 CPUtime=6.1 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 5190 1260 0 0 610 0 0 0 25 0 9 0 878143432 306896896 36126 33554432000 4194304 4417452 140736876743408 18446744073709551615 4356889 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.19
Current children cumulated vsize (KiB) 299704

[startup+12.7009 s]
/proc/loadavg: 2.21 1.95 1.96 9/180 24891
/proc/meminfo: memFree=31862776/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=397200 CPUtime=100.36 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 176326 1260 0 0 10001 35 0 0 25 0 9 0 878143416 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 99300 60500 180 55 0 97186 0
[pid=24877/tid=24884] ppid=24875 vsize=397200 CPUtime=12.52 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 20983 1260 0 0 1249 3 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4232626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=397200 CPUtime=12.52 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 19971 1260 0 0 1249 3 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=397200 CPUtime=12.53 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 33567 1260 0 0 1246 7 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=397200 CPUtime=12.53 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 21117 1260 0 0 1248 5 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4357273 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=397200 CPUtime=12.53 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 8402 1260 0 0 1252 1 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4236296 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=397200 CPUtime=12.53 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 22505 1260 0 0 1248 5 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=397200 CPUtime=12.45 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 27530 1260 0 0 1241 4 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364711 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=397200 CPUtime=12.51 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 13148 1260 0 0 1249 2 0 0 25 0 9 0 878143432 406732800 60500 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.36
Current children cumulated vsize (KiB) 397200

[startup+25.5007 s]
/proc/loadavg: 3.65 2.28 2.07 9/180 24891
/proc/meminfo: memFree=31758572/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=503732 CPUtime=202.66 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 284786 1260 0 0 20211 55 0 0 25 0 9 0 878143416 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 125933 87133 180 55 0 123819 0
[pid=24877/tid=24884] ppid=24875 vsize=503732 CPUtime=25.33 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 34604 1260 0 0 2527 6 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=503732 CPUtime=25.33 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 28534 1260 0 0 2528 5 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4320821 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=503732 CPUtime=25.32 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 64510 1260 0 0 2519 13 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=503732 CPUtime=25.33 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 29699 1260 0 0 2526 7 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=503732 CPUtime=25.32 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 11254 1260 0 0 2530 2 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=503732 CPUtime=25.32 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 51916 1260 0 0 2522 10 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=503732 CPUtime=25.19 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 37263 1260 0 0 2513 6 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=503732 CPUtime=25.3 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 17903 1260 0 0 2528 2 0 0 25 0 9 0 878143432 515821568 87133 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.66
Current children cumulated vsize (KiB) 503732

[startup+51.1011 s]
/proc/loadavg: 5.13 2.74 2.23 9/180 24892
/proc/meminfo: memFree=31546216/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=694708 CPUtime=407.33 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 514569 1260 0 0 40635 98 0 0 25 0 9 0 878143416 711380992 134877 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 173677 134877 180 55 0 171563 0
[pid=24877/tid=24884] ppid=24875 vsize=694708 CPUtime=50.92 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 54896 1260 0 0 5083 9 0 0 25 0 9 0 878143432 711380992 134877 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=694708 CPUtime=50.92 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 54540 1260 0 0 5083 9 0 0 25 0 9 0 878143432 711380992 134877 33554432000 4194304 4417452 140736876743408 18446744073709551615 4270186 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=694708 CPUtime=50.93 cores=0-7

################
# More data... #
################

[pid=24877/tid=24886] ppid=24875 vsize=5361156 CPUtime=4721.42 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2929554 1260 0 0 471564 578 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5361156 CPUtime=4722.24 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 472065 159 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5361156 CPUtime=4722.21 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2187902 1260 0 0 471816 405 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5361156 CPUtime=4721.79 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3040420 1260 0 0 471517 662 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5361156 CPUtime=4696.41 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2144979 1260 0 0 469258 383 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5361156 CPUtime=4722.19 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 1996027 1260 0 0 471882 337 0 0 25 0 9 0 878143432 5489823744 1301475 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37750.8
Current children cumulated vsize (KiB) 5361156

[startup+4782.3 s]
/proc/loadavg: 8.40 8.25 8.13 9/180 25030
/proc/meminfo: memFree=26594904/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=5644556 CPUtime=38230.4 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17002122 1260 0 0 3819783 3259 0 0 25 0 9 0 878143416 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 1411139 1372325 180 55 0 1409025 0
[pid=24877/tid=24884] ppid=24875 vsize=5644556 CPUtime=4782.22 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1405986 1260 0 0 477933 289 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=5644556 CPUtime=4782.08 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 2573097 1260 0 0 477773 435 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=5644556 CPUtime=4781.41 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2929554 1260 0 0 477563 578 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5644556 CPUtime=4782.23 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 478064 159 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5644556 CPUtime=4782.21 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2187902 1260 0 0 477816 405 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5644556 CPUtime=4781.77 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3096083 1260 0 0 477509 668 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5644556 CPUtime=4756.09 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2146471 1260 0 0 475225 384 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5644556 CPUtime=4782.18 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 1996027 1260 0 0 477881 337 0 0 25 0 9 0 878143432 5780025344 1372325 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38230.4
Current children cumulated vsize (KiB) 5644556

[startup+4842.3 s]
/proc/loadavg: 8.29 8.23 8.13 9/180 25032
/proc/meminfo: memFree=26785336/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=5455376 CPUtime=38710.1 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17099043 1260 0 0 3867729 3280 0 0 25 0 9 0 878143416 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 1363844 1325030 180 55 0 1361730 0
[pid=24877/tid=24884] ppid=24875 vsize=5455376 CPUtime=4842.23 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1405986 1260 0 0 483934 289 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=5455376 CPUtime=4842.07 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 2623459 1260 0 0 483760 447 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4366412 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=5455376 CPUtime=4841.41 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2938054 1260 0 0 483561 580 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5455376 CPUtime=4842.23 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 484064 159 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5455376 CPUtime=4842.21 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2200671 1260 0 0 483814 407 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5455376 CPUtime=4841.76 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3104022 1260 0 0 483507 669 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4259186 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5455376 CPUtime=4815.75 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2153899 1260 0 0 481190 385 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5455376 CPUtime=4842.19 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 2005950 1260 0 0 483881 338 0 0 25 0 9 0 878143432 5586305024 1325030 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38710.1
Current children cumulated vsize (KiB) 5455376

[startup+4902.3 s]
/proc/loadavg: 8.30 8.24 8.13 10/180 25033
/proc/meminfo: memFree=26725296/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=5551244 CPUtime=39189.8 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17140363 1260 0 0 3915692 3285 0 0 25 0 9 0 878143416 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 1387811 1348997 180 55 0 1385697 0
[pid=24877/tid=24884] ppid=24875 vsize=5551244 CPUtime=4902.23 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1405986 1260 0 0 489934 289 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=5551244 CPUtime=4902.08 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 2656215 1260 0 0 489756 452 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=5551244 CPUtime=4901.41 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2938054 1260 0 0 489561 580 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5551244 CPUtime=4902.23 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 490064 159 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5551244 CPUtime=4902.21 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2200671 1260 0 0 489814 407 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5551244 CPUtime=4901.77 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3109099 1260 0 0 489507 670 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5551244 CPUtime=4875.44 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2157386 1260 0 0 487158 386 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5551244 CPUtime=4902.19 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 2005950 1260 0 0 489881 338 0 0 25 0 9 0 878143432 5684473856 1348997 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39189.8
Current children cumulated vsize (KiB) 5551244

[startup+4962.3 s]
/proc/loadavg: 8.26 8.22 8.13 10/180 25035
/proc/meminfo: memFree=26301932/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=5936948 CPUtime=39669.4 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17264793 1260 0 0 3963640 3304 0 0 25 0 9 0 878143416 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 1484237 1445423 180 55 0 1482123 0
[pid=24877/tid=24884] ppid=24875 vsize=5936948 CPUtime=4962.23 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1414179 1260 0 0 495933 290 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=5936948 CPUtime=4962.08 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 2669979 1260 0 0 495753 455 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=5936948 CPUtime=4961.41 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2938054 1260 0 0 495561 580 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5936948 CPUtime=4962.23 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 496064 159 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5936948 CPUtime=4962.21 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2235526 1260 0 0 495810 411 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5936948 CPUtime=4961.76 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3121931 1260 0 0 495504 672 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5936948 CPUtime=4935.1 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2184285 1260 0 0 493118 392 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5936948 CPUtime=4962.19 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 2033837 1260 0 0 495878 341 0 0 25 0 9 0 878143432 6079434752 1445423 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39669.4
Current children cumulated vsize (KiB) 5936948



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.7 s]
/proc/loadavg: 8.19 8.21 8.13 9/180 25036
/proc/meminfo: memFree=26529196/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=5710084 CPUtime=40000.5 cores=0-7
/proc/24877/stat : 24877 (plingeling) S 24875 24877 24694 0 -1 4202496 17465602 1260 0 0 3996717 3331 0 0 25 0 9 0 878143416 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 1427521 1388706 180 55 0 1425407 0
[pid=24877/tid=24884] ppid=24875 vsize=5710084 CPUtime=5003.64 cores=0-7
/proc/24877/task/24884/stat : 24884 (plingeling) R 24875 24877 24694 0 -1 4202560 1422371 1260 0 0 500072 292 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24877/tid=24885] ppid=24875 vsize=5710084 CPUtime=5003.48 cores=0-7
/proc/24877/task/24885/stat : 24885 (plingeling) R 24875 24877 24694 0 -1 4202560 2669979 1260 0 0 499893 455 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24877/tid=24886] ppid=24875 vsize=5710084 CPUtime=5002.82 cores=0-7
/proc/24877/task/24886/stat : 24886 (plingeling) R 24875 24877 24694 0 -1 4202560 2981302 1260 0 0 499695 587 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24877/tid=24887] ppid=24875 vsize=5710084 CPUtime=5003.64 cores=0-7
/proc/24877/task/24887/stat : 24887 (plingeling) R 24875 24877 24694 0 -1 4202560 657899 1260 0 0 500205 159 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24877/tid=24888] ppid=24875 vsize=5710084 CPUtime=5003.62 cores=0-7
/proc/24877/task/24888/stat : 24888 (plingeling) R 24875 24877 24694 0 -1 4202560 2235526 1260 0 0 499951 411 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24877/tid=24889] ppid=24875 vsize=5710084 CPUtime=5003.16 cores=0-7
/proc/24877/task/24889/stat : 24889 (plingeling) R 24875 24877 24694 0 -1 4202560 3130948 1260 0 0 499642 674 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=5710084 CPUtime=4976.29 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4202560 2311659 1260 0 0 497224 405 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24877/tid=24891] ppid=24875 vsize=5710084 CPUtime=5003.6 cores=0-7
/proc/24877/task/24891/stat : 24891 (plingeling) R 24875 24877 24694 0 -1 4202560 2046815 1260 0 0 500017 343 0 0 25 0 9 0 878143432 5847126016 1388706 33554432000 4194304 4417452 140736876743408 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 5710084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.81 s]
/proc/loadavg: 8.19 8.21 8.13 2/174 25037
/proc/meminfo: memFree=29060332/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=0 CPUtime=40000.6 cores=0-7
/proc/24877/stat : 24877 (plingeling) Z 24875 24877 24694 0 -1 4203548 17465602 1260 0 0 3996721 3341 0 0 18 0 2 0 878143416 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 0 0 0 0 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=0 CPUtime=4976.39 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4203588 2311659 1260 0 0 497224 415 0 0 25 0 2 0 878143432 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

[startup+5003.91 s]
/proc/loadavg: 8.19 8.21 8.13 2/174 25037
/proc/meminfo: memFree=29060332/32951124 swapFree=67063272/67111528
[pid=24877] ppid=24875 vsize=0 CPUtime=40000.7 cores=0-7
/proc/24877/stat : 24877 (plingeling) Z 24875 24877 24694 0 -1 4203548 17465602 1260 0 0 3996721 3350 0 0 18 0 2 0 878143416 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24877/statm: 0 0 0 0 0 0 0
[pid=24877/tid=24890] ppid=24875 vsize=0 CPUtime=4976.48 cores=0-7
/proc/24877/task/24890/stat : 24890 (plingeling) R 24875 24877 24694 0 -1 4203588 2311659 1260 0 0 497224 424 0 0 25 0 2 0 878143432 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5003.93
CPU time (s): 40000.7
CPU user time (s): 39967.2
CPU system time (s): 33.5319
CPU usage (%): 799.386
Max. virtual memory (cumulated for all children) (KiB): 6919872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39967.2
system time used= 33.5319
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17466862
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 400
involuntary context switches= 348719

runsolver used 8.09377 second user time and 19.2101 second system time

The end

Launcher Data 

Begin job on node132 at 2011-06-10 02:24:13
IDJOB=3394466
IDBENCH=83177
IDSOLVER=1851
FILE ID=node132/3394466-1307665452
RUNJOBID= node132-1307665452-24708
PBS_JOBID= 13549441
Free space on /tmp= 74188 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-9x32.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394466-1307665452/watcher-3394466-1307665452 -o /tmp/evaluation-result-3394466-1307665452/solver-3394466-1307665452 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394466-1307665452.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= bcc12436eba65ad776b55f23c6f42298
RANDOM SEED=979575591

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32090684 kB
Buffers:        204448 kB
Cached:         429020 kB
SwapCached:       9968 kB
Active:         355460 kB
Inactive:       295580 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32090684 kB
SwapTotal:    67111528 kB
SwapFree:     67063272 kB
Dirty:            1904 kB
Writeback:           0 kB
AnonPages:       15456 kB
Mapped:           9560 kB
Slab:           141244 kB
PageTables:       3756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   156108 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74184 MiB
End job on node132 at 2011-06-10 03:47:38