Trace number 3257810

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.31 1201.68

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v945c61409g4.cnf
MD5SUM04c9f68df814bad18919ca17a3e0867a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.342947
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257810-1304047168/watcher-3257810-1304047168 -o /tmp/evaluation-result-3257810-1304047168/solver-3257810-1304047168 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3257810-1304047168.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.14 8.00 5/181 10002
/proc/meminfo: memFree=25959652/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=9004 CPUtime=0 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) R 10000 10002 9252 0 -1 4202496 317 1251 0 0 0 0 0 0 25 0 1 0 516315519 9220096 245 33554432000 4194304 4417332 140737410016848 18446744073709551615 251813936907 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10002/statm: 2251 261 146 55 0 137 0

[startup+0.0401041 s]
/proc/loadavg: 8.17 8.14 8.00 5/181 10002
/proc/meminfo: memFree=25959652/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=17404 CPUtime=0.03 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) R 10000 10002 9252 0 -1 4202496 2426 1251 0 0 3 0 0 0 25 0 1 0 516315519 17821696 2354 33554432000 4194304 4417332 140737410016848 18446744073709551615 4262041 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10002/statm: 4351 2354 147 55 0 2237 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 17404

[startup+0.147087 s]
/proc/loadavg: 8.17 8.14 8.00 5/181 10002
/proc/meminfo: memFree=25959652/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=128096 CPUtime=0.44 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 4414 1251 0 0 44 0 0 0 25 0 5 0 516315519 131170304 3441 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 32024 3441 177 55 0 29910 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 128096

[startup+0.301061 s]
/proc/loadavg: 8.17 8.14 8.00 5/181 10002
/proc/meminfo: memFree=25959652/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=130304 CPUtime=1.05 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 5303 1251 0 0 105 0 0 0 25 0 5 0 516315519 133431296 3995 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 32576 3995 181 55 0 30462 0
Current children cumulated CPU time (s) 1.05
Current children cumulated vsize (KiB) 130304

[startup+0.700995 s]
/proc/loadavg: 8.17 8.14 8.00 5/181 10002
/proc/meminfo: memFree=25959652/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=133576 CPUtime=2.65 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 6875 1251 0 0 265 0 0 0 25 0 5 0 516315519 136781824 4813 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 33394 4813 181 55 0 31280 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 133576

[startup+1.50086 s]
/proc/loadavg: 8.16 8.14 8.00 9/186 10012
/proc/meminfo: memFree=25940400/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=139184 CPUtime=5.85 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 10518 1251 0 0 584 1 0 0 25 0 5 0 516315519 142524416 6215 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 34796 6215 181 55 0 32682 0
[pid=10002/tid=10009] ppid=10000 vsize=139184 CPUtime=1.45 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 1257 1251 0 0 145 0 0 0 25 0 5 0 516315524 142524416 6215 33554432000 4194304 4417332 140737410016848 18446744073709551615 4249228 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=139184 CPUtime=1.45 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 1199 1251 0 0 145 0 0 0 25 0 5 0 516315524 142524416 6215 33554432000 4194304 4417332 140737410016848 18446744073709551615 4258382 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=139184 CPUtime=1.45 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 580 1251 0 0 145 0 0 0 25 0 5 0 516315524 142524416 6215 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=139184 CPUtime=1.44 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 5044 1251 0 0 144 0 0 0 25 0 5 0 516315524 142524416 6215 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 139184

[startup+3.10064 s]
/proc/loadavg: 8.16 8.14 8.00 9/186 10012
/proc/meminfo: memFree=25930728/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=140720 CPUtime=12.24 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 15241 1251 0 0 1222 2 0 0 25 0 5 0 516315519 144097280 6601 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 35180 6601 181 55 0 33066 0
[pid=10002/tid=10009] ppid=10000 vsize=140720 CPUtime=3.05 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 1257 1251 0 0 305 0 0 0 25 0 5 0 516315524 144097280 6601 33554432000 4194304 4417332 140737410016848 18446744073709551615 4258258 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=140720 CPUtime=3.05 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 1199 1251 0 0 305 0 0 0 25 0 5 0 516315524 144097280 6601 33554432000 4194304 4417332 140737410016848 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=140720 CPUtime=3.05 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 672 1251 0 0 305 0 0 0 25 0 5 0 516315524 144097280 6601 33554432000 4194304 4417332 140737410016848 18446744073709551615 4264959 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=140720 CPUtime=3.03 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 9675 1251 0 0 302 1 0 0 25 0 5 0 516315524 144097280 6601 33554432000 4194304 4417332 140737410016848 18446744073709551615 251814298026 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.24
Current children cumulated vsize (KiB) 140720

[startup+6.30106 s]
/proc/loadavg: 8.16 8.14 8.00 9/186 10012
/proc/meminfo: memFree=25920800/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=163180 CPUtime=25.02 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 25652 1251 0 0 2499 3 0 0 25 0 5 0 516315519 167096320 12218 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 40795 12218 181 55 0 38681 0
[pid=10002/tid=10009] ppid=10000 vsize=163180 CPUtime=6.25 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 1257 1251 0 0 625 0 0 0 25 0 5 0 516315524 167096320 12218 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=163180 CPUtime=6.25 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 1199 1251 0 0 625 0 0 0 25 0 5 0 516315524 167096320 12218 33554432000 4194304 4417332 140737410016848 18446744073709551615 4356735 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=163180 CPUtime=6.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 2601 1251 0 0 625 0 0 0 25 0 5 0 516315524 167096320 12218 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=163180 CPUtime=6.22 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 18157 1251 0 0 619 3 0 0 25 0 5 0 516315524 167096320 12218 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 163180

[startup+12.701 s]
/proc/loadavg: 8.13 8.13 8.00 9/186 10013
/proc/meminfo: memFree=25891756/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=185800 CPUtime=50.59 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 43621 1251 0 0 5054 5 0 0 25 0 5 0 516315519 190259200 17897 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 46450 17897 181 55 0 44336 0
[pid=10002/tid=10009] ppid=10000 vsize=185800 CPUtime=12.65 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 4590 1251 0 0 1265 0 0 0 25 0 5 0 516315524 190259200 17897 33554432000 4194304 4417332 140737410016848 18446744073709551615 4251167 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=185800 CPUtime=12.65 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 3338 1251 0 0 1265 0 0 0 25 0 5 0 516315524 190259200 17897 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=185800 CPUtime=12.65 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 4376 1251 0 0 1265 0 0 0 25 0 5 0 516315524 190259200 17897 33554432000 4194304 4417332 140737410016848 18446744073709551615 4258382 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=185800 CPUtime=12.58 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 28879 1251 0 0 1254 4 0 0 25 0 5 0 516315524 190259200 17897 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.59
Current children cumulated vsize (KiB) 185800

[startup+25.5008 s]
/proc/loadavg: 8.11 8.13 8.00 9/186 10013
/proc/meminfo: memFree=25786476/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=211584 CPUtime=101.72 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 85816 1251 0 0 10160 12 0 0 25 0 5 0 516315519 216662016 24315 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 52896 24315 181 55 0 50782 0
[pid=10002/tid=10009] ppid=10000 vsize=211584 CPUtime=25.45 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 15237 1251 0 0 2543 2 0 0 25 0 5 0 516315524 216662016 24315 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=211584 CPUtime=25.44 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 11862 1251 0 0 2543 1 0 0 25 0 5 0 516315524 216662016 24315 33554432000 4194304 4417332 140737410016848 18446744073709551615 4259008 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=211584 CPUtime=25.45 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 14274 1251 0 0 2544 1 0 0 25 0 5 0 516315524 216662016 24315 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=211584 CPUtime=25.31 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 42005 1251 0 0 2525 6 0 0 25 0 5 0 516315524 216662016 24315 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.72
Current children cumulated vsize (KiB) 211584

[startup+51.1005 s]
/proc/loadavg: 8.07 8.12 8.00 9/186 10014
/proc/meminfo: memFree=25733984/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=276132 CPUtime=203.98 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 151316 1251 0 0 20376 22 0 0 25 0 5 0 516315519 282759168 40452 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 69033 40452 181 55 0 66919 0
[pid=10002/tid=10009] ppid=10000 vsize=276132 CPUtime=51.05 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 26718 1251 0 0 5101 4 0 0 25 0 5 0 516315524 282759168 40452 33554432000 4194304 4417332 140737410016848 18446744073709551615 4277920 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=276132 CPUtime=51.04 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 26164 1251 0 0 5101 3 0 0 25 0 5 0 516315524 282759168 40452 33554432000 4194304 4417332 140737410016848 18446744073709551615 4366359 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=276132 CPUtime=51.04 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 30842 1251 0 0 5101 3 0 0 25 0 5 0 516315524 282759168 40452 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=276132 CPUtime=50.77 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 65154 1251 0 0 5067 10 0 0 25 0 5 0 516315524 282759168 40452 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.98
Current children cumulated vsize (KiB) 276132

[startup+102.307 s]
/proc/loadavg: 8.03 8.10 8.00 9/186 10015
/proc/meminfo: memFree=25630556/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=326256 CPUtime=408.52 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 250284 1251 0 0 40814 38 0 0 25 0 5 0 516315519 334086144 51960 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 81564 51960 181 55 0 79450 0
[pid=10002/tid=10009] ppid=10000 vsize=326256 CPUtime=102.25 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 45768 1251 0 0 10219 6 0 0 25 0 5 0 516315524 334086144 51960 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=326256 CPUtime=102.25 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 45891 1251 0 0 10218 7 0 0 25 0 5 0 516315524 334086144 51960 33554432000 4194304 4417332 140737410016848 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=326256 CPUtime=102.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 56922 1251 0 0 10218 7 0 0 25 0 5 0 516315524 334086144 51960 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=326256 CPUtime=101.7 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 99265 1251 0 0 10154 16 0 0 25 0 5 0 516315524 334086144 51960 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.52
Current children cumulated vsize (KiB) 326256

[startup+162.301 s]
/proc/loadavg: 8.12 8.11 8.01 10/186 10017
/proc/meminfo: memFree=25624584/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=337672 CPUtime=648.17 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 356188 1251 0 0 64762 55 0 0 25 0 5 0 516315519 345776128 55837 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 84418 55837 181 55 0 82304 0
[pid=10002/tid=10009] ppid=10000 vsize=337672 CPUtime=162.25 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 58344 1251 0 0 16217 8 0 0 25 0 5 0 516315524 345776128 55837 33554432000 4194304 4417332 140737410016848 18446744073709551615 4308162 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=337672 CPUtime=162.23 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 67811 1251 0 0 16213 10 0 0 25 0 5 0 516315524 345776128 55837 33554432000 4194304 4417332 140737410016848 18446744073709551615 4236744 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=337672 CPUtime=162.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 87863 1251 0 0 16212 13 0 0 25 0 5 0 516315524 345776128 55837 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=337672 CPUtime=161.37 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 139732 1251 0 0 16114 23 0 0 25 0 5 0 516315524 345776128 55837 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.17
Current children cumulated vsize (KiB) 337672


################
# More data... #
################

[pid=10002/tid=10010] ppid=10000 vsize=837688 CPUtime=702.19 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 191842 1251 0 0 70190 29 0 0 25 0 5 0 516315524 857792512 180873 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364788 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=837688 CPUtime=702.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 251761 1251 0 0 70187 38 0 0 25 0 5 0 516315524 857792512 180873 33554432000 4194304 4417332 140737410016848 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=837688 CPUtime=698.62 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 322637 1251 0 0 69809 53 0 0 25 0 5 0 516315524 857792512 180873 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.38
Current children cumulated vsize (KiB) 837688

[startup+762.306 s]
/proc/loadavg: 4.09 5.47 6.87 5/176 10051
/proc/meminfo: memFree=25863936/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=988068 CPUtime=3045.13 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1004053 1251 0 0 304354 159 0 0 25 0 5 0 516315519 1011781632 218468 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 247017 218468 181 55 0 244903 0
[pid=10002/tid=10009] ppid=10000 vsize=988068 CPUtime=762.27 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 203101 1251 0 0 76197 30 0 0 25 0 5 0 516315524 1011781632 218468 33554432000 4194304 4417332 140737410016848 18446744073709551615 4310334 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=988068 CPUtime=762.19 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 203106 1251 0 0 76188 31 0 0 25 0 5 0 516315524 1011781632 218468 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=988068 CPUtime=762.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 251761 1251 0 0 76187 38 0 0 25 0 5 0 516315524 1011781632 218468 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=988068 CPUtime=758.34 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 343647 1251 0 0 75777 57 0 0 25 0 5 0 516315524 1011781632 218468 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3045.13
Current children cumulated vsize (KiB) 988068

[startup+822.301 s]
/proc/loadavg: 4.07 5.22 6.70 5/176 10052
/proc/meminfo: memFree=25806880/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1059472 CPUtime=3284.83 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1038602 1251 0 0 328317 166 0 0 25 0 5 0 516315519 1084899328 236319 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 264868 236319 181 55 0 262754 0
[pid=10002/tid=10009] ppid=10000 vsize=1059472 CPUtime=822.26 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 219230 1251 0 0 82194 32 0 0 25 0 5 0 516315524 1084899328 236319 33554432000 4194304 4417332 140737410016848 18446744073709551615 4343668 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1059472 CPUtime=822.18 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 215755 1251 0 0 82184 34 0 0 25 0 5 0 516315524 1084899328 236319 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1059472 CPUtime=822.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 251761 1251 0 0 82187 38 0 0 25 0 5 0 516315524 1084899328 236319 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1059472 CPUtime=818.07 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 349418 1251 0 0 81748 59 0 0 25 0 5 0 516315524 1084899328 236319 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.83
Current children cumulated vsize (KiB) 1059472

[startup+882.301 s]
/proc/loadavg: 4.06 5.01 6.53 5/176 10054
/proc/meminfo: memFree=25865396/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=986908 CPUtime=3524.54 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1085372 1251 0 0 352281 173 0 0 25 0 5 0 516315519 1010593792 218178 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 246727 218178 181 55 0 244613 0
[pid=10002/tid=10009] ppid=10000 vsize=986908 CPUtime=882.26 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 219230 1251 0 0 88194 32 0 0 25 0 5 0 516315524 1010593792 218178 33554432000 4194304 4417332 140737410016848 18446744073709551615 4365994 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=986908 CPUtime=882.18 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 233670 1251 0 0 88181 37 0 0 25 0 5 0 516315524 1010593792 218178 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=986908 CPUtime=882.26 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 272424 1251 0 0 88184 42 0 0 25 0 5 0 516315524 1010593792 218178 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=986908 CPUtime=877.78 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 357610 1251 0 0 87717 61 0 0 25 0 5 0 516315524 1010593792 218178 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.54
Current children cumulated vsize (KiB) 986908

[startup+942.301 s]
/proc/loadavg: 4.05 4.83 6.37 5/176 10056
/proc/meminfo: memFree=25835244/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1016452 CPUtime=3764.25 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1120865 1251 0 0 376246 179 0 0 25 0 5 0 516315519 1040846848 225564 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 254113 225564 181 55 0 251999 0
[pid=10002/tid=10009] ppid=10000 vsize=1016452 CPUtime=942.26 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 226318 1251 0 0 94193 33 0 0 25 0 5 0 516315524 1040846848 225564 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1016452 CPUtime=942.17 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 233670 1251 0 0 94180 37 0 0 25 0 5 0 516315524 1040846848 225564 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1016452 CPUtime=942.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 295938 1251 0 0 94180 45 0 0 25 0 5 0 516315524 1040846848 225564 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1016452 CPUtime=937.5 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 362501 1251 0 0 93688 62 0 0 25 0 5 0 516315524 1040846848 225564 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3764.25
Current children cumulated vsize (KiB) 1016452

[startup+1002.3 s]
/proc/loadavg: 4.02 4.68 6.22 5/176 10057
/proc/meminfo: memFree=25737384/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1114368 CPUtime=4003.95 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1167699 1251 0 0 400208 187 0 0 25 0 5 0 516315519 1141112832 250043 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 278592 250043 181 55 0 276478 0
[pid=10002/tid=10009] ppid=10000 vsize=1114368 CPUtime=1002.26 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 245234 1251 0 0 100190 36 0 0 25 0 5 0 516315524 1141112832 250043 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364599 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1114368 CPUtime=1002.16 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 261588 1251 0 0 100175 41 0 0 25 0 5 0 516315524 1141112832 250043 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1114368 CPUtime=1002.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 295938 1251 0 0 100180 45 0 0 25 0 5 0 516315524 1141112832 250043 33554432000 4194304 4417332 140737410016848 18446744073709551615 4344055 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1114368 CPUtime=997.2 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 362501 1251 0 0 99658 62 0 0 25 0 5 0 516315524 1141112832 250043 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.95
Current children cumulated vsize (KiB) 1114368

[startup+1062.3 s]
/proc/loadavg: 4.00 4.55 6.08 5/176 10059
/proc/meminfo: memFree=25685164/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1166740 CPUtime=4243.66 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1180792 1251 0 0 424177 189 0 0 25 0 5 0 516315519 1194741760 263136 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 291685 263136 181 55 0 289571 0
[pid=10002/tid=10009] ppid=10000 vsize=1166740 CPUtime=1062.26 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 245234 1251 0 0 106190 36 0 0 25 0 5 0 516315524 1194741760 263136 33554432000 4194304 4417332 140737410016848 18446744073709551615 4346425 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1166740 CPUtime=1062.16 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 261588 1251 0 0 106175 41 0 0 25 0 5 0 516315524 1194741760 263136 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1166740 CPUtime=1062.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 295938 1251 0 0 106179 46 0 0 25 0 5 0 516315524 1194741760 263136 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1166740 CPUtime=1056.92 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 375594 1251 0 0 105628 64 0 0 25 0 5 0 516315524 1194741760 263136 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.66
Current children cumulated vsize (KiB) 1166740

[startup+1122.3 s]
/proc/loadavg: 4.07 4.47 5.95 5/176 10060
/proc/meminfo: memFree=25516260/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1335832 CPUtime=4483.37 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1239370 1251 0 0 448138 199 0 0 25 0 5 0 516315519 1367891968 305409 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 333958 305409 181 55 0 331844 0
[pid=10002/tid=10009] ppid=10000 vsize=1335832 CPUtime=1122.27 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 267762 1251 0 0 112187 40 0 0 25 0 5 0 516315524 1367891968 305409 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1335832 CPUtime=1122.15 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 261588 1251 0 0 112174 41 0 0 25 0 5 0 516315524 1367891968 305409 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1335832 CPUtime=1122.25 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 320447 1251 0 0 112174 51 0 0 25 0 5 0 516315524 1367891968 305409 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1335832 CPUtime=1116.63 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 387135 1251 0 0 111597 66 0 0 25 0 5 0 516315524 1367891968 305409 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4483.37
Current children cumulated vsize (KiB) 1335832

[startup+1182.3 s]
/proc/loadavg: 4.02 4.38 5.83 5/176 10062
/proc/meminfo: memFree=25340784/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1510988 CPUtime=4723.09 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1294197 1251 0 0 472099 210 0 0 25 0 5 0 516315519 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 377747 349166 181 55 0 375633 0
[pid=10002/tid=10009] ppid=10000 vsize=1510988 CPUtime=1182.27 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 267762 1251 0 0 118187 40 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1510988 CPUtime=1182.15 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 295679 1251 0 0 118168 47 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1510988 CPUtime=1182.26 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 320447 1251 0 0 118175 51 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1510988 CPUtime=1176.35 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 407871 1251 0 0 117565 70 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4723.09
Current children cumulated vsize (KiB) 1510988



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 4.02 4.35 5.79 5/176 10062
/proc/meminfo: memFree=25340780/32950928 swapFree=67111524/67111528
[pid=10002] ppid=10000 vsize=1510988 CPUtime=4800.2 cores=0,2,4,6
/proc/10002/stat : 10002 (plingeling) S 10000 10002 9252 0 -1 4202496 1294197 1251 0 0 479810 210 0 0 25 0 5 0 516315519 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10002/statm: 377747 349166 181 55 0 375633 0
[pid=10002/tid=10009] ppid=10000 vsize=1510988 CPUtime=1201.58 cores=0,2,4,6
/proc/10002/task/10009/stat : 10009 (plingeling) R 10000 10002 9252 0 -1 4202560 267762 1251 0 0 120118 40 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10002/tid=10010] ppid=10000 vsize=1510988 CPUtime=1201.45 cores=0,2,4,6
/proc/10002/task/10010/stat : 10010 (plingeling) R 10000 10002 9252 0 -1 4202560 295679 1251 0 0 120098 47 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10002/tid=10011] ppid=10000 vsize=1510988 CPUtime=1201.56 cores=0,2,4,6
/proc/10002/task/10011/stat : 10011 (plingeling) R 10000 10002 9252 0 -1 4202560 320447 1251 0 0 120105 51 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10002/tid=10012] ppid=10000 vsize=1510988 CPUtime=1195.55 cores=0,2,4,6
/proc/10002/task/10012/stat : 10012 (plingeling) R 10000 10002 9252 0 -1 4202560 407871 1251 0 0 119485 70 0 0 25 0 5 0 516315524 1547251712 349166 33554432000 4194304 4417332 140737410016848 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 1510988

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.68
CPU time (s): 4800.31
CPU user time (s): 4798.13
CPU system time (s): 2.17267
CPU usage (%): 399.467
Max. virtual memory (cumulated for all children) (KiB): 1510988

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.13
system time used= 2.17267
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1295448
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 135
involuntary context switches= 22496

runsolver used 1.74273 second user time and 4.28835 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-29 05:19:28
IDJOB=3257810
IDBENCH=71271
IDSOLVER=1605
FILE ID=node126/3257810-1304047168
RUNJOBID= node126-1304044269-9270
PBS_JOBID= 13170390
Free space on /tmp= 71592 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v945c61409g4.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257810-1304047168/watcher-3257810-1304047168 -o /tmp/evaluation-result-3257810-1304047168/solver-3257810-1304047168 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3257810-1304047168.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 04c9f68df814bad18919ca17a3e0867a
RANDOM SEED=1614310449

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25959924 kB
Buffers:       1407036 kB
Cached:        4195668 kB
SwapCached:          4 kB
Active:         965448 kB
Inactive:      5480216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25959924 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             824 kB
Writeback:           0 kB
AnonPages:      843032 kB
Mapped:          15112 kB
Slab:           479900 kB
PageTables:       6096 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1027780 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71596 MiB
End job on node126 at 2011-04-29 05:39:32