Trace number 3291277

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.26 1201.77

General information on the benchmark

NameSAT03/industrial/maris/CNF/
gripper13u.shuffled-as.sat03-395.cnf
MD5SUM3889b7ed90cc1fbe8bc8d140a1763832
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4427.96
Satisfiable
(Un)Satisfiability was proved
Number of variables4268
Number of clauses38965
Sum of the clauses size86077
Maximum clause length28
Minimum clause length1
Number of clauses of size 169
Number of clauses of size 235984
Number of clauses of size 3104
Number of clauses of size 42704
Number of clauses of size 50
Number of clauses of size over 5104

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291277-1304101182/watcher-3291277-1304101182 -o /tmp/evaluation-result-3291277-1304101182/solver-3291277-1304101182 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3291277-1304101182.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.05 8.07 6/181 20308
/proc/meminfo: memFree=17806308/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=10456 CPUtime=0 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) R 20306 20308 19929 0 -1 4202496 695 1251 0 0 0 0 0 0 25 0 1 0 521720794 10706944 624 33554432000 4194304 4417332 140737056212336 18446744073709551615 216634134143 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/20308/statm: 2614 624 147 55 0 500 0

[startup+0.174979 s]
/proc/loadavg: 8.07 8.05 8.07 6/181 20308
/proc/meminfo: memFree=17806308/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=57016 CPUtime=0.55 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 2670 1251 0 0 55 0 0 0 25 0 5 0 521720794 58384384 2069 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 14254 2069 176 55 0 12140 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 57016

[startup+0.200974 s]
/proc/loadavg: 8.07 8.05 8.07 6/181 20308
/proc/meminfo: memFree=17806308/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=56792 CPUtime=0.66 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 2693 1251 0 0 66 0 0 0 25 0 5 0 521720794 58155008 2014 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 14198 2014 177 55 0 12084 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 56792

[startup+0.300957 s]
/proc/loadavg: 8.07 8.05 8.07 6/181 20308
/proc/meminfo: memFree=17806308/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=58296 CPUtime=1.06 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 3069 1251 0 0 106 0 0 0 25 0 5 0 521720794 59695104 2390 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 14574 2390 177 55 0 12460 0
Current children cumulated CPU time (s) 1.06
Current children cumulated vsize (KiB) 58296

[startup+0.700887 s]
/proc/loadavg: 8.07 8.05 8.07 6/181 20308
/proc/meminfo: memFree=17806308/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=128344 CPUtime=2.65 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 5377 1251 0 0 265 0 0 0 25 0 5 0 521720794 131424256 3567 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 32086 3567 181 55 0 29972 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 128344

[startup+1.50075 s]
/proc/loadavg: 8.07 8.05 8.07 9/186 20318
/proc/meminfo: memFree=17782220/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=136208 CPUtime=5.85 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 9739 1251 0 0 584 1 0 0 25 0 5 0 521720794 139476992 5545 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 34052 5545 181 55 0 31938 0
[pid=20308/tid=20315] ppid=20306 vsize=136208 CPUtime=1.44 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 1230 1251 0 0 144 0 0 0 25 0 5 0 521720798 139476992 5545 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364491 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=136208 CPUtime=1.45 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 1284 1251 0 0 145 0 0 0 25 0 5 0 521720798 139476992 5545 33554432000 4194304 4417332 140737056212336 18446744073709551615 4366468 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=136208 CPUtime=1.45 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 1213 1251 0 0 145 0 0 0 25 0 5 0 521720798 139476992 5545 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=136208 CPUtime=1.44 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 3993 1251 0 0 144 0 0 0 25 0 5 0 521720798 139476992 5545 33554432000 4194304 4417332 140737056212336 18446744073709551615 4354352 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 136208

[startup+3.10047 s]
/proc/loadavg: 8.07 8.05 8.07 9/186 20318
/proc/meminfo: memFree=17786312/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=141924 CPUtime=12.25 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 15127 1251 0 0 1222 3 0 0 25 0 5 0 521720794 145330176 6941 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 35481 6941 181 55 0 33367 0
[pid=20308/tid=20315] ppid=20306 vsize=141924 CPUtime=3.04 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 1715 1251 0 0 304 0 0 0 25 0 5 0 521720798 145330176 6941 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=141924 CPUtime=3.05 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 1713 1251 0 0 305 0 0 0 25 0 5 0 521720798 145330176 6941 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=141924 CPUtime=3.05 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 1809 1251 0 0 305 0 0 0 25 0 5 0 521720798 145330176 6941 33554432000 4194304 4417332 140737056212336 18446744073709551615 4357131 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=141924 CPUtime=3.04 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 7871 1251 0 0 303 1 0 0 25 0 5 0 521720798 145330176 6941 33554432000 4194304 4417332 140737056212336 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.25
Current children cumulated vsize (KiB) 141924

[startup+6.30091 s]
/proc/loadavg: 8.07 8.05 8.07 9/186 20318
/proc/meminfo: memFree=17766844/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=151680 CPUtime=25.03 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 30643 1251 0 0 2498 5 0 0 25 0 5 0 521720794 155320320 9375 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 37920 9375 181 55 0 35806 0
[pid=20308/tid=20315] ppid=20306 vsize=151680 CPUtime=6.22 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 4669 1251 0 0 622 0 0 0 25 0 5 0 521720798 155320320 9375 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=151680 CPUtime=6.25 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 4067 1251 0 0 625 0 0 0 25 0 5 0 521720798 155320320 9375 33554432000 4194304 4417332 140737056212336 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=151680 CPUtime=6.25 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 4755 1251 0 0 625 0 0 0 25 0 5 0 521720798 155320320 9375 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=151680 CPUtime=6.24 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 15133 1251 0 0 622 2 0 0 25 0 5 0 521720798 155320320 9375 33554432000 4194304 4417332 140737056212336 18446744073709551615 4251121 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.03
Current children cumulated vsize (KiB) 151680

[startup+12.7008 s]
/proc/loadavg: 8.06 8.05 8.07 9/186 20318
/proc/meminfo: memFree=17737444/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=166028 CPUtime=50.6 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 56192 1251 0 0 5050 10 0 0 25 0 5 0 521720794 170012672 12962 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 41507 12962 181 55 0 39393 0
[pid=20308/tid=20315] ppid=20306 vsize=166028 CPUtime=12.58 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 8445 1251 0 0 1257 1 0 0 25 0 5 0 521720798 170012672 12962 33554432000 4194304 4417332 140737056212336 18446744073709551615 4343668 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=166028 CPUtime=12.64 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 8975 1251 0 0 1263 1 0 0 25 0 5 0 521720798 170012672 12962 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=166028 CPUtime=12.65 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 9749 1251 0 0 1264 1 0 0 25 0 5 0 521720798 170012672 12962 33554432000 4194304 4417332 140737056212336 18446744073709551615 4312160 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=166028 CPUtime=12.64 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 27004 1251 0 0 1260 4 0 0 25 0 5 0 521720798 170012672 12962 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.6
Current children cumulated vsize (KiB) 166028

[startup+25.5005 s]
/proc/loadavg: 8.05 8.05 8.07 9/186 20319
/proc/meminfo: memFree=17722432/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=179388 CPUtime=101.72 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 96283 1251 0 0 10155 17 0 0 25 0 5 0 521720794 183693312 16302 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 44847 16302 181 55 0 42733 0
[pid=20308/tid=20315] ppid=20306 vsize=179388 CPUtime=25.31 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 13736 1251 0 0 2529 2 0 0 25 0 5 0 521720798 183693312 16302 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364769 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=179388 CPUtime=25.45 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 17749 1251 0 0 2542 3 0 0 25 0 5 0 521720798 183693312 16302 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=179388 CPUtime=25.44 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 16399 1251 0 0 2542 2 0 0 25 0 5 0 521720798 183693312 16302 33554432000 4194304 4417332 140737056212336 18446744073709551615 4366381 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=179388 CPUtime=25.45 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 46380 1251 0 0 2537 8 0 0 25 0 5 0 521720798 183693312 16302 33554432000 4194304 4417332 140737056212336 18446744073709551615 4357123 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.72
Current children cumulated vsize (KiB) 179388

[startup+51.101 s]
/proc/loadavg: 8.03 8.04 8.06 9/186 20319
/proc/meminfo: memFree=17671096/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=197896 CPUtime=203.98 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 172962 1251 0 0 20370 28 0 0 25 0 5 0 521720794 202645504 20929 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 49474 20929 181 55 0 47360 0
[pid=20308/tid=20315] ppid=20306 vsize=197896 CPUtime=50.77 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 25790 1251 0 0 5073 4 0 0 25 0 5 0 521720798 202645504 20929 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=197896 CPUtime=51.05 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 33795 1251 0 0 5099 6 0 0 25 0 5 0 521720798 202645504 20929 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=197896 CPUtime=51.05 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 30524 1251 0 0 5101 4 0 0 25 0 5 0 521720798 202645504 20929 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=197896 CPUtime=51.04 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 80834 1251 0 0 5092 12 0 0 25 0 5 0 521720798 202645504 20929 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.98
Current children cumulated vsize (KiB) 197896

[startup+102.301 s]
/proc/loadavg: 8.12 8.06 8.07 9/186 20321
/proc/meminfo: memFree=17506144/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=303668 CPUtime=408.52 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 295024 1251 0 0 40805 47 0 0 25 0 5 0 521720794 310956032 47372 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 75917 47372 181 55 0 73803 0
[pid=20308/tid=20315] ppid=20306 vsize=303668 CPUtime=101.69 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 45487 1251 0 0 10162 7 0 0 25 0 5 0 521720798 310956032 47372 33554432000 4194304 4417332 140737056212336 18446744073709551615 4264781 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=303668 CPUtime=102.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 58501 1251 0 0 10215 11 0 0 25 0 5 0 521720798 310956032 47372 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=303668 CPUtime=102.26 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 48463 1251 0 0 10219 7 0 0 25 0 5 0 521720798 310956032 47372 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=303668 CPUtime=102.25 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 140554 1251 0 0 10204 21 0 0 25 0 5 0 521720798 310956032 47372 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.52
Current children cumulated vsize (KiB) 303668

[startup+162.3 s]
/proc/loadavg: 8.22 8.10 8.08 9/186 20322
/proc/meminfo: memFree=17413220/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=416452 CPUtime=648.18 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 393154 1251 0 0 64754 64 0 0 25 0 5 0 521720794 426446848 75568 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 104113 75568 181 55 0 101999 0
[pid=20308/tid=20315] ppid=20306 vsize=416452 CPUtime=161.35 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 56195 1251 0 0 16127 8 0 0 25 0 5 0 521720798 426446848 75568 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=416452 CPUtime=162.25 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 73670 1251 0 0 16212 13 0 0 25 0 5 0 521720798 426446848 75568 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=416452 CPUtime=162.25 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 65159 1251 0 0 16215 10 0 0 25 0 5 0 521720798 426446848 75568 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=416452 CPUtime=162.25 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 196111 1251 0 0 16195 30 0 0 25 0 5 0 521720798 426446848 75568 33554432000 4194304 4417332 140737056212336 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 648.18
Current children cumulated vsize (KiB) 416452


################
# More data... #
################

[pid=20308/tid=20316] ppid=20306 vsize=938532 CPUtime=702.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 154620 1251 0 0 70200 26 0 0 25 0 5 0 521720798 961056768 206088 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=938532 CPUtime=702.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 189607 1251 0 0 70198 29 0 0 25 0 5 0 521720798 961056768 206088 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=938532 CPUtime=702.26 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 431216 1251 0 0 70154 72 0 0 25 0 5 0 521720798 961056768 206088 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2805.21
Current children cumulated vsize (KiB) 938532

[startup+762.301 s]
/proc/loadavg: 8.04 8.08 8.08 9/186 20338
/proc/meminfo: memFree=16878628/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=734208 CPUtime=3044.91 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 987583 1251 0 0 304327 164 0 0 25 0 5 0 521720794 751828992 154061 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 183552 154061 181 55 0 181438 0
[pid=20308/tid=20315] ppid=20306 vsize=734208 CPUtime=758.02 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 144954 1251 0 0 75778 24 0 0 25 0 5 0 521720798 751828992 154061 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=734208 CPUtime=762.27 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 163056 1251 0 0 76199 28 0 0 25 0 5 0 521720798 751828992 154061 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=734208 CPUtime=762.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 198634 1251 0 0 76197 30 0 0 25 0 5 0 521720798 751828992 154061 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=734208 CPUtime=762.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 478920 1251 0 0 76147 80 0 0 25 0 5 0 521720798 751828992 154061 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.91
Current children cumulated vsize (KiB) 734208

[startup+822.3 s]
/proc/loadavg: 8.12 8.10 8.09 9/186 20340
/proc/meminfo: memFree=16751248/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=799248 CPUtime=3284.56 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1041776 1251 0 0 328284 172 0 0 25 0 5 0 521720794 818429952 170321 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 199812 170321 181 55 0 197698 0
[pid=20308/tid=20315] ppid=20306 vsize=799248 CPUtime=817.69 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 174571 1251 0 0 81740 29 0 0 25 0 5 0 521720798 818429952 170321 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=799248 CPUtime=822.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 179440 1251 0 0 82196 30 0 0 25 0 5 0 521720798 818429952 170321 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=799248 CPUtime=822.26 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 206826 1251 0 0 82195 31 0 0 25 0 5 0 521720798 818429952 170321 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=799248 CPUtime=822.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 478920 1251 0 0 82147 80 0 0 25 0 5 0 521720798 818429952 170321 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.56
Current children cumulated vsize (KiB) 799248

[startup+882.307 s]
/proc/loadavg: 8.16 8.11 8.09 9/186 20342
/proc/meminfo: memFree=16645052/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=838240 CPUtime=3524.25 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1076635 1251 0 0 352248 177 0 0 25 0 5 0 521720794 858357760 180069 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 209560 180069 181 55 0 207446 0
[pid=20308/tid=20315] ppid=20306 vsize=838240 CPUtime=877.36 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 193046 1251 0 0 87704 32 0 0 25 0 5 0 521720798 858357760 180069 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=838240 CPUtime=882.27 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 179440 1251 0 0 88197 30 0 0 25 0 5 0 521720798 858357760 180069 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=838240 CPUtime=882.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 223210 1251 0 0 88194 33 0 0 25 0 5 0 521720798 858357760 180069 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=838240 CPUtime=882.28 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 478920 1251 0 0 88148 80 0 0 25 0 5 0 521720798 858357760 180069 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3524.25
Current children cumulated vsize (KiB) 838240

[startup+942.3 s]
/proc/loadavg: 8.16 8.12 8.09 9/186 20343
/proc/meminfo: memFree=16440420/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1011512 CPUtime=3763.9 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1170761 1251 0 0 376200 190 0 0 25 0 5 0 521720794 1035788288 223615 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 252878 223615 181 55 0 250764 0
[pid=20308/tid=20315] ppid=20306 vsize=1011512 CPUtime=937.03 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 93669 34 0 0 25 0 5 0 521720798 1035788288 223615 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1011512 CPUtime=942.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 197572 1251 0 0 94194 32 0 0 25 0 5 0 521720798 1035788288 223615 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1011512 CPUtime=942.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 263184 1251 0 0 94189 38 0 0 25 0 5 0 521720798 1035788288 223615 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1011512 CPUtime=942.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 506748 1251 0 0 94143 84 0 0 25 0 5 0 521720798 1035788288 223615 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.9
Current children cumulated vsize (KiB) 1011512

[startup+1002.3 s]
/proc/loadavg: 8.15 8.12 8.09 9/186 20345
/proc/meminfo: memFree=16335488/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1062372 CPUtime=4003.57 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1199877 1251 0 0 400162 195 0 0 25 0 5 0 521720794 1087868928 236330 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 265593 236330 181 55 0 263479 0
[pid=20308/tid=20315] ppid=20306 vsize=1062372 CPUtime=996.69 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 99635 34 0 0 25 0 5 0 521720798 1087868928 236330 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1062372 CPUtime=1002.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 197572 1251 0 0 100194 32 0 0 25 0 5 0 521720798 1087868928 236330 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1062372 CPUtime=1002.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 279568 1251 0 0 100187 40 0 0 25 0 5 0 521720798 1087868928 236330 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364788 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1062372 CPUtime=1002.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 519480 1251 0 0 100141 86 0 0 25 0 5 0 521720798 1087868928 236330 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4003.57
Current children cumulated vsize (KiB) 1062372

[startup+1062.3 s]
/proc/loadavg: 8.22 8.14 8.10 9/186 20346
/proc/meminfo: memFree=16242808/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1117992 CPUtime=4243.25 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1230166 1251 0 0 424127 198 0 0 25 0 5 0 521720794 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 279498 250235 181 55 0 277384 0
[pid=20308/tid=20315] ppid=20306 vsize=1117992 CPUtime=1056.36 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 105602 34 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1117992 CPUtime=1062.26 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 197572 1251 0 0 106194 32 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1117992 CPUtime=1062.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 295952 1251 0 0 106185 42 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1117992 CPUtime=1062.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 533385 1251 0 0 106140 87 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4243.25
Current children cumulated vsize (KiB) 1117992

[startup+1122.3 s]
/proc/loadavg: 6.77 7.81 7.99 5/176 20366
/proc/meminfo: memFree=16904100/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1117992 CPUtime=4482.93 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1230166 1251 0 0 448095 198 0 0 25 0 5 0 521720794 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 279498 250235 181 55 0 277384 0
[pid=20308/tid=20315] ppid=20306 vsize=1117992 CPUtime=1116.04 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 111570 34 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1117992 CPUtime=1122.27 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 197572 1251 0 0 112195 32 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1117992 CPUtime=1122.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 295952 1251 0 0 112185 42 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1117992 CPUtime=1122.27 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 533385 1251 0 0 112140 87 0 0 25 0 5 0 521720798 1144823808 250235 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4482.93
Current children cumulated vsize (KiB) 1117992

[startup+1182.3 s]
/proc/loadavg: 5.02 7.11 7.73 5/176 20367
/proc/meminfo: memFree=16809492/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1209592 CPUtime=4722.65 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1271162 1251 0 0 472060 205 0 0 25 0 5 0 521720794 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 302398 273853 181 55 0 300284 0
[pid=20308/tid=20315] ppid=20306 vsize=1209592 CPUtime=1175.76 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 117542 34 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1209592 CPUtime=1182.27 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 212051 1251 0 0 118192 35 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1209592 CPUtime=1182.27 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 317107 1251 0 0 118181 46 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1209592 CPUtime=1182.28 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 538747 1251 0 0 118140 88 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4722.65
Current children cumulated vsize (KiB) 1209592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 4.73 6.91 7.65 5/176 20368
/proc/meminfo: memFree=16809492/32951124 swapFree=67111528/67111528
[pid=20308] ppid=20306 vsize=1209592 CPUtime=4800.17 cores=0,2,4,6
/proc/20308/stat : 20308 (plingeling) S 20306 20308 19929 0 -1 4202496 1271162 1251 0 0 479812 205 0 0 25 0 5 0 521720794 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20308/statm: 302398 273853 181 55 0 300284 0
[pid=20308/tid=20315] ppid=20306 vsize=1209592 CPUtime=1195.06 cores=0,2,4,6
/proc/20308/task/20315/stat : 20315 (plingeling) R 20306 20308 19929 0 -1 4202560 201238 1251 0 0 119472 34 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20308/tid=20316] ppid=20306 vsize=1209592 CPUtime=1201.67 cores=0,2,4,6
/proc/20308/task/20316/stat : 20316 (plingeling) R 20306 20308 19929 0 -1 4202560 212051 1251 0 0 120132 35 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20308/tid=20317] ppid=20306 vsize=1209592 CPUtime=1201.68 cores=0,2,4,6
/proc/20308/task/20317/stat : 20317 (plingeling) R 20306 20308 19929 0 -1 4202560 317107 1251 0 0 120122 46 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20308/tid=20318] ppid=20306 vsize=1209592 CPUtime=1201.69 cores=0,2,4,6
/proc/20308/task/20318/stat : 20318 (plingeling) R 20306 20308 19929 0 -1 4202560 538747 1251 0 0 120081 88 0 0 25 0 5 0 521720798 1238622208 273853 33554432000 4194304 4417332 140737056212336 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 1209592

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.77
CPU time (s): 4800.26
CPU user time (s): 4798.15
CPU system time (s): 2.11268
CPU usage (%): 399.434
Max. virtual memory (cumulated for all children) (KiB): 1209592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.15
system time used= 2.11268
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1272413
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 97
involuntary context switches= 24090

runsolver used 2.02469 second user time and 4.45632 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-29 20:19:42
IDJOB=3291277
IDBENCH=84180
IDSOLVER=1605
FILE ID=node103/3291277-1304101182
RUNJOBID= node103-1304098739-19947
PBS_JOBID= 13170621
Free space on /tmp= 71516 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/industrial/maris/CNF/gripper13u.shuffled-as.sat03-395.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291277-1304101182/watcher-3291277-1304101182 -o /tmp/evaluation-result-3291277-1304101182/solver-3291277-1304101182 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3291277-1304101182.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3889b7ed90cc1fbe8bc8d140a1763832
RANDOM SEED=1509173207

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17806464 kB
Buffers:       2148948 kB
Cached:       12247880 kB
SwapCached:          0 kB
Active:        5686764 kB
Inactive:      8875176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17806464 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             796 kB
Writeback:           0 kB
AnonPages:      164408 kB
Mapped:          15092 kB
Slab:           519856 kB
PageTables:       4980 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   347496 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71516 MiB
End job on node103 at 2011-04-29 20:39:45