Trace number 3263530

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.28 1201.96

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf
MD5SUM5bd7c76aed56f767985526812cdb8e0e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark935.889
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses31962
Sum of the clauses size64344
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 231947
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 515

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263530-1304099905/watcher-3263530-1304099905 -o /tmp/evaluation-result-3263530-1304099905/solver-3263530-1304099905 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3263530-1304099905.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.75 8.04 7.90 6/181 20486
/proc/meminfo: memFree=29072556/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=9184 CPUtime=0 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) R 20484 20486 19972 0 -1 4202496 388 1252 0 0 0 0 0 0 25 0 1 0 521590850 9404416 317 33554432000 4194304 4417332 140734807074896 18446744073709551615 253640859392 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/20486/statm: 2296 317 146 55 0 182 0

[startup+0.147528 s]
/proc/loadavg: 7.75 8.04 7.90 6/181 20486
/proc/meminfo: memFree=29072556/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=122248 CPUtime=0.5 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 3133 1252 0 0 50 0 0 0 25 0 5 0 521590850 125181952 1998 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 30562 1998 180 55 0 28448 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 122248

[startup+0.200518 s]
/proc/loadavg: 7.75 8.04 7.90 6/181 20486
/proc/meminfo: memFree=29072556/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=123536 CPUtime=0.71 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 3740 1252 0 0 71 0 0 0 25 0 5 0 521590850 126500864 2324 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 30884 2324 181 55 0 28770 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 123536

[startup+0.3005 s]
/proc/loadavg: 7.75 8.04 7.90 6/181 20486
/proc/meminfo: memFree=29072556/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=126732 CPUtime=1.11 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 4536 1252 0 0 111 0 0 0 25 0 5 0 521590850 129773568 3120 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 31683 3120 181 55 0 29569 0
Current children cumulated CPU time (s) 1.11
Current children cumulated vsize (KiB) 126732

[startup+0.700429 s]
/proc/loadavg: 7.75 8.04 7.90 6/181 20486
/proc/meminfo: memFree=29072556/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=132540 CPUtime=2.71 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 6757 1252 0 0 271 0 0 0 25 0 5 0 521590850 135720960 4572 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 33135 4572 181 55 0 31021 0
Current children cumulated CPU time (s) 2.71
Current children cumulated vsize (KiB) 132540

[startup+1.50028 s]
/proc/loadavg: 7.75 8.04 7.90 9/186 20496
/proc/meminfo: memFree=29131240/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=143428 CPUtime=5.91 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 12656 1252 0 0 590 1 0 0 25 0 5 0 521590850 146870272 7326 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 35857 7326 181 55 0 33743 0
[pid=20486/tid=20493] ppid=20484 vsize=143428 CPUtime=1.47 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 566 1252 0 0 147 0 0 0 25 0 5 0 521590853 146870272 7326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=143428 CPUtime=1.46 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 731 1252 0 0 146 0 0 0 25 0 5 0 521590853 146870272 7326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4249991 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=143428 CPUtime=1.46 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 3945 1252 0 0 146 0 0 0 25 0 5 0 521590853 146870272 7326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4365999 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=143428 CPUtime=1.47 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 5985 1252 0 0 147 0 0 0 25 0 5 0 521590853 146870272 7326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364695 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 143428

[startup+3.101 s]
/proc/loadavg: 7.75 8.04 7.90 9/186 20496
/proc/meminfo: memFree=29021736/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=151456 CPUtime=12.3 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 23169 1252 0 0 1228 2 0 0 25 0 5 0 521590850 155090944 9333 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 37864 9333 181 55 0 35750 0
[pid=20486/tid=20493] ppid=20484 vsize=151456 CPUtime=3.07 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 566 1252 0 0 307 0 0 0 25 0 5 0 521590853 155090944 9333 33554432000 4194304 4417332 140734807074896 18446744073709551615 4249216 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=151456 CPUtime=3.06 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 731 1252 0 0 306 0 0 0 25 0 5 0 521590853 155090944 9333 33554432000 4194304 4417332 140734807074896 18446744073709551615 4249935 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=151456 CPUtime=3.06 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 8415 1252 0 0 306 0 0 0 25 0 5 0 521590853 155090944 9333 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=151456 CPUtime=3.06 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 12028 1252 0 0 305 1 0 0 25 0 5 0 521590853 155090944 9333 33554432000 4194304 4417332 140734807074896 18446744073709551615 4246261 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 151456

[startup+6.30041 s]
/proc/loadavg: 7.85 8.05 7.90 9/186 20496
/proc/meminfo: memFree=28993460/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=190288 CPUtime=25.08 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 46723 1252 0 0 2503 5 0 0 25 0 5 0 521590850 194854912 19009 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 47572 19009 181 55 0 45458 0
[pid=20486/tid=20493] ppid=20484 vsize=190288 CPUtime=6.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 3454 1252 0 0 627 0 0 0 25 0 5 0 521590853 194854912 19009 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=190288 CPUtime=6.23 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 3652 1252 0 0 623 0 0 0 25 0 5 0 521590853 194854912 19009 33554432000 4194304 4417332 140734807074896 18446744073709551615 4365065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=190288 CPUtime=6.27 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 18492 1252 0 0 625 2 0 0 25 0 5 0 521590853 194854912 19009 33554432000 4194304 4417332 140734807074896 18446744073709551615 4250721 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=190288 CPUtime=6.26 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 19696 1252 0 0 624 2 0 0 25 0 5 0 521590853 194854912 19009 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 190288

[startup+12.7012 s]
/proc/loadavg: 7.86 8.05 7.90 9/186 20496
/proc/meminfo: memFree=28953248/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=226756 CPUtime=50.65 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 95669 1252 0 0 5053 12 0 0 25 0 5 0 521590850 232198144 28126 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 56689 28126 181 55 0 54575 0
[pid=20486/tid=20493] ppid=20484 vsize=226756 CPUtime=12.67 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 10911 1252 0 0 1266 1 0 0 25 0 5 0 521590853 232198144 28126 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=226756 CPUtime=12.6 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 15787 1252 0 0 1258 2 0 0 25 0 5 0 521590853 232198144 28126 33554432000 4194304 4417332 140734807074896 18446744073709551615 4309712 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=226756 CPUtime=12.67 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 39046 1252 0 0 1263 4 0 0 25 0 5 0 521590853 232198144 28126 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=226756 CPUtime=12.66 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 28496 1252 0 0 1263 3 0 0 25 0 5 0 521590853 232198144 28126 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 226756

[startup+25.5009 s]
/proc/loadavg: 7.97 8.07 7.91 9/186 20496
/proc/meminfo: memFree=28852076/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=293704 CPUtime=101.78 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 164854 1252 0 0 10156 22 0 0 25 0 5 0 521590850 300752896 44863 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 73426 44863 181 55 0 71312 0
[pid=20486/tid=20493] ppid=20484 vsize=293704 CPUtime=25.47 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 27042 1252 0 0 2544 3 0 0 25 0 5 0 521590853 300752896 44863 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=293704 CPUtime=25.33 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 29995 1252 0 0 2529 4 0 0 25 0 5 0 521590853 300752896 44863 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=293704 CPUtime=25.47 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 58142 1252 0 0 2540 7 0 0 25 0 5 0 521590853 300752896 44863 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=293704 CPUtime=25.47 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 48246 1252 0 0 2540 7 0 0 25 0 5 0 521590853 300752896 44863 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 293704

[startup+51.1012 s]
/proc/loadavg: 7.98 8.06 7.91 9/186 20497
/proc/meminfo: memFree=28898820/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=354896 CPUtime=204.04 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 322554 1252 0 0 20362 42 0 0 25 0 5 0 521590850 363413504 60161 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 88724 60161 181 55 0 86610 0
[pid=20486/tid=20493] ppid=20484 vsize=354896 CPUtime=51.06 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 55646 1252 0 0 5100 6 0 0 25 0 5 0 521590853 363413504 60161 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=354896 CPUtime=50.79 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 55086 1252 0 0 5072 7 0 0 25 0 5 0 521590853 363413504 60161 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=354896 CPUtime=51.06 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 140557 1252 0 0 5089 17 0 0 25 0 5 0 521590853 363413504 60161 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=354896 CPUtime=51.07 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 69836 1252 0 0 5097 10 0 0 25 0 5 0 521590853 363413504 60161 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 354896

[startup+102.301 s]
/proc/loadavg: 8.08 8.08 7.92 9/186 20498
/proc/meminfo: memFree=28766636/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=415952 CPUtime=408.58 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 495140 1252 0 0 40792 66 0 0 25 0 5 0 521590850 425934848 75425 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 103988 75425 181 55 0 101874 0
[pid=20486/tid=20493] ppid=20484 vsize=415952 CPUtime=102.28 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 87943 1252 0 0 10217 11 0 0 25 0 5 0 521590853 425934848 75425 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=415952 CPUtime=101.71 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 87135 1252 0 0 10160 11 0 0 25 0 5 0 521590853 425934848 75425 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=415952 CPUtime=102.27 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 214315 1252 0 0 10200 27 0 0 25 0 5 0 521590853 425934848 75425 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=415952 CPUtime=102.28 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 104318 1252 0 0 10212 16 0 0 25 0 5 0 521590853 425934848 75425 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.58
Current children cumulated vsize (KiB) 415952

[startup+162.301 s]
/proc/loadavg: 8.11 8.09 7.93 9/186 20509
/proc/meminfo: memFree=28352132/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=631556 CPUtime=648.23 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 776313 1252 0 0 64721 102 0 0 25 0 5 0 521590850 646713344 129326 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 157889 129326 181 55 0 155775 0
[pid=20486/tid=20493] ppid=20484 vsize=631556 CPUtime=162.26 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 128596 1252 0 0 16210 16 0 0 25 0 5 0 521590853 646713344 129326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=631556 CPUtime=161.38 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 118409 1252 0 0 16124 14 0 0 25 0 5 0 521590853 646713344 129326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=631556 CPUtime=162.25 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 365905 1252 0 0 16180 45 0 0 25 0 5 0 521590853 646713344 129326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=631556 CPUtime=162.27 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 161974 1252 0 0 16203 24 0 0 25 0 5 0 521590853 646713344 129326 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.23
Current children cumulated vsize (KiB) 631556


################
# More data... #
################

[pid=20486/tid=20494] ppid=20484 vsize=1020104 CPUtime=698.45 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 429502 1252 0 0 69786 59 0 0 25 0 5 0 521590853 1044586496 226463 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1020104 CPUtime=702.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 975965 1252 0 0 70100 124 0 0 25 0 5 0 521590853 1044586496 226463 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1020104 CPUtime=701.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 361505 1252 0 0 70093 53 0 0 25 0 5 0 521590853 1044586496 226463 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.47
Current children cumulated vsize (KiB) 1020104

[startup+762.3 s]
/proc/loadavg: 8.12 8.08 8.00 9/186 20565
/proc/meminfo: memFree=29065676/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=914712 CPUtime=3044.16 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2246755 1252 0 0 304110 306 0 0 25 0 5 0 521590850 936665088 200115 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 228678 200115 181 55 0 226564 0
[pid=20486/tid=20493] ppid=20484 vsize=914712 CPUtime=762.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 411330 1252 0 0 76170 57 0 0 25 0 5 0 521590853 936665088 200115 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=914712 CPUtime=758.13 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 461948 1252 0 0 75750 63 0 0 25 0 5 0 521590853 936665088 200115 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=914712 CPUtime=762.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 990382 1252 0 0 76098 126 0 0 25 0 5 0 521590853 936665088 200115 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=914712 CPUtime=761.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 381666 1252 0 0 76089 57 0 0 25 0 5 0 521590853 936665088 200115 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.16
Current children cumulated vsize (KiB) 914712

[startup+822.3 s]
/proc/loadavg: 8.04 8.06 8.00 9/186 20566
/proc/meminfo: memFree=28819268/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=998736 CPUtime=3283.82 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2339033 1252 0 0 328065 317 0 0 25 0 5 0 521590850 1022705664 221121 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 249684 221121 181 55 0 247570 0
[pid=20486/tid=20493] ppid=20484 vsize=998736 CPUtime=822.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 415426 1252 0 0 82169 58 0 0 25 0 5 0 521590853 1022705664 221121 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=998736 CPUtime=817.8 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 494716 1252 0 0 81713 67 0 0 25 0 5 0 521590853 1022705664 221121 33554432000 4194304 4417332 140734807074896 18446744073709551615 4343680 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=998736 CPUtime=822.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1025083 1252 0 0 82093 131 0 0 25 0 5 0 521590853 1022705664 221121 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=998736 CPUtime=821.45 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 402379 1252 0 0 82086 59 0 0 25 0 5 0 521590853 1022705664 221121 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3283.82
Current children cumulated vsize (KiB) 998736

[startup+882.306 s]
/proc/loadavg: 8.01 8.05 8.00 9/186 20568
/proc/meminfo: memFree=28559464/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1038464 CPUtime=3523.52 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2465468 1252 0 0 352019 333 0 0 25 0 5 0 521590850 1063387136 231053 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 259616 231053 181 55 0 257502 0
[pid=20486/tid=20493] ppid=20484 vsize=1038464 CPUtime=882.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 441672 1252 0 0 88165 62 0 0 25 0 5 0 521590853 1063387136 231053 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1038464 CPUtime=877.48 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 494716 1252 0 0 87681 67 0 0 25 0 5 0 521590853 1063387136 231053 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1038464 CPUtime=882.25 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1114935 1252 0 0 88083 142 0 0 25 0 5 0 521590853 1063387136 231053 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1038464 CPUtime=881.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 412716 1252 0 0 88086 60 0 0 25 0 5 0 521590853 1063387136 231053 33554432000 4194304 4417332 140734807074896 18446744073709551615 4321404 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.52
Current children cumulated vsize (KiB) 1038464

[startup+942.3 s]
/proc/loadavg: 8.00 8.04 8.00 9/186 20570
/proc/meminfo: memFree=28614136/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1097672 CPUtime=3763.18 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2675374 1252 0 0 375957 361 0 0 25 0 5 0 521590850 1124016128 245855 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 274418 245855 181 55 0 272304 0
[pid=20486/tid=20493] ppid=20484 vsize=1097672 CPUtime=942.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 475339 1252 0 0 94160 67 0 0 25 0 5 0 521590853 1124016128 245855 33554432000 4194304 4417332 140734807074896 18446744073709551615 4343343 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1097672 CPUtime=937.15 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 494716 1252 0 0 93648 67 0 0 25 0 5 0 521590853 1124016128 245855 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1097672 CPUtime=942.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1278885 1252 0 0 94061 163 0 0 25 0 5 0 521590853 1124016128 245855 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1097672 CPUtime=941.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 425005 1252 0 0 94084 62 0 0 25 0 5 0 521590853 1124016128 245855 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.18
Current children cumulated vsize (KiB) 1097672

[startup+1002.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/186 20571
/proc/meminfo: memFree=28595900/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1076492 CPUtime=4002.85 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2763971 1252 0 0 399915 370 0 0 25 0 5 0 521590850 1102327808 240560 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 269123 240560 181 55 0 267009 0
[pid=20486/tid=20493] ppid=20484 vsize=1076492 CPUtime=1002.26 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 530842 1252 0 0 100154 72 0 0 25 0 5 0 521590853 1102327808 240560 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1076492 CPUtime=996.83 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 497836 1252 0 0 99615 68 0 0 25 0 5 0 521590853 1102327808 240560 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1076492 CPUtime=1002.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1300667 1252 0 0 100058 166 0 0 25 0 5 0 521590853 1102327808 240560 33554432000 4194304 4417332 140734807074896 18446744073709551615 4275960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1076492 CPUtime=1001.47 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 433197 1252 0 0 100084 63 0 0 25 0 5 0 521590853 1102327808 240560 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4002.85
Current children cumulated vsize (KiB) 1076492

[startup+1062.3 s]
/proc/loadavg: 8.16 8.07 8.01 9/186 20573
/proc/meminfo: memFree=28654532/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1086908 CPUtime=4242.53 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 2856274 1252 0 0 423870 383 0 0 25 0 5 0 521590850 1112993792 243164 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 271727 243164 181 55 0 269613 0
[pid=20486/tid=20493] ppid=20484 vsize=1086908 CPUtime=1062.26 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 537238 1252 0 0 106153 73 0 0 25 0 5 0 521590853 1112993792 243164 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1086908 CPUtime=1056.5 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 540714 1252 0 0 105576 74 0 0 25 0 5 0 521590853 1112993792 243164 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1086908 CPUtime=1062.24 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1335504 1252 0 0 106054 170 0 0 25 0 5 0 521590853 1112993792 243164 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1086908 CPUtime=1061.47 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 441389 1252 0 0 106083 64 0 0 25 0 5 0 521590853 1112993792 243164 33554432000 4194304 4417332 140734807074896 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.53
Current children cumulated vsize (KiB) 1086908

[startup+1122.3 s]
/proc/loadavg: 8.17 8.09 8.02 9/186 20574
/proc/meminfo: memFree=28276688/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1285080 CPUtime=4482.21 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 3004510 1252 0 0 447819 402 0 0 25 0 5 0 521590850 1315921920 292707 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 321270 292707 181 55 0 319156 0
[pid=20486/tid=20493] ppid=20484 vsize=1285080 CPUtime=1122.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 595192 1252 0 0 112145 82 0 0 25 0 5 0 521590853 1315921920 292707 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1285080 CPUtime=1116.18 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 568420 1252 0 0 111540 78 0 0 25 0 5 0 521590853 1315921920 292707 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1285080 CPUtime=1122.25 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1373503 1252 0 0 112050 175 0 0 25 0 5 0 521590853 1315921920 292707 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1285080 CPUtime=1121.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 465966 1252 0 0 112080 66 0 0 25 0 5 0 521590853 1315921920 292707 33554432000 4194304 4417332 140734807074896 18446744073709551615 4365371 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.21
Current children cumulated vsize (KiB) 1285080

[startup+1182.3 s]
/proc/loadavg: 8.24 8.12 8.03 9/186 20576
/proc/meminfo: memFree=28097500/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1317852 CPUtime=4721.89 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 3033183 1252 0 0 471783 406 0 0 25 0 5 0 521590850 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 329463 300900 181 55 0 327349 0
[pid=20486/tid=20493] ppid=20484 vsize=1317852 CPUtime=1182.27 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 607480 1252 0 0 118144 83 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1317852 CPUtime=1175.85 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 568420 1252 0 0 117507 78 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1317852 CPUtime=1182.25 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1373503 1252 0 0 118050 175 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1317852 CPUtime=1181.46 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 482351 1252 0 0 118078 68 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.89
Current children cumulated vsize (KiB) 1317852



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.17 8.11 8.02 9/186 20577
/proc/meminfo: memFree=28064636/32951124 swapFree=67111364/67111528
[pid=20486] ppid=20484 vsize=1317852 CPUtime=4800.21 cores=1,3,5,7
/proc/20486/stat : 20486 (plingeling) S 20484 20486 19972 0 -1 4202496 3033183 1252 0 0 479615 406 0 0 25 0 5 0 521590850 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/20486/statm: 329463 300900 181 55 0 327349 0
[pid=20486/tid=20493] ppid=20484 vsize=1317852 CPUtime=1201.87 cores=1,3,5,7
/proc/20486/task/20493/stat : 20493 (plingeling) R 20484 20486 19972 0 -1 4202560 607480 1252 0 0 120104 83 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=20486/tid=20494] ppid=20484 vsize=1317852 CPUtime=1195.35 cores=1,3,5,7
/proc/20486/task/20494/stat : 20494 (plingeling) R 20484 20486 19972 0 -1 4202560 568420 1252 0 0 119457 78 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20486/tid=20495] ppid=20484 vsize=1317852 CPUtime=1201.86 cores=1,3,5,7
/proc/20486/task/20495/stat : 20495 (plingeling) R 20484 20486 19972 0 -1 4202560 1373503 1252 0 0 120011 175 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20486/tid=20496] ppid=20484 vsize=1317852 CPUtime=1201.07 cores=1,3,5,7
/proc/20486/task/20496/stat : 20496 (plingeling) R 20484 20486 19972 0 -1 4202560 482351 1252 0 0 120039 68 0 0 25 0 5 0 521590853 1349480448 300900 33554432000 4194304 4417332 140734807074896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 1317852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.96
CPU time (s): 4800.28
CPU user time (s): 4796.17
CPU system time (s): 4.10938
CPU usage (%): 399.372
Max. virtual memory (cumulated for all children) (KiB): 1317852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.17
system time used= 4.10938
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3034436
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 167
involuntary context switches= 35978

runsolver used 1.92071 second user time and 4.64329 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-29 19:58:25
IDJOB=3263530
IDBENCH=83985
IDSOLVER=1605
FILE ID=node106/3263530-1304099905
RUNJOBID= node106-1304097373-19991
PBS_JOBID= 13170612
Free space on /tmp= 72160 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263530-1304099905/watcher-3263530-1304099905 -o /tmp/evaluation-result-3263530-1304099905/solver-3263530-1304099905 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3263530-1304099905.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bd7c76aed56f767985526812cdb8e0e
RANDOM SEED=1296546298

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29072712 kB
Buffers:        253632 kB
Cached:        2074812 kB
SwapCached:         88 kB
Active:        2057992 kB
Inactive:      1605948 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29072712 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             456 kB
Writeback:           0 kB
AnonPages:     1335328 kB
Mapped:          15476 kB
Slab:           146416 kB
PageTables:       6936 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1545048 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72160 MiB
End job on node106 at 2011-04-29 20:18:29