Trace number 3371477

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.32 1203.63

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
32/aes_32_4_keyfind_1.cnf
MD5SUMd71ab4cbe872e5620884d4e4d370890a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1092.34
Satisfiable
(Un)Satisfiability was proved
Number of variables912
Number of clauses3488
Sum of the clauses size11040
Maximum clause length5
Minimum clause length1
Number of clauses of size 180
Number of clauses of size 2160
Number of clauses of size 32432
Number of clauses of size 4736
Number of clauses of size 580
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371477-1305429174/watcher-3371477-1305429174 -o /tmp/evaluation-result-3371477-1305429174/solver-3371477-1305429174 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371477-1305429174.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.80 7.93 6.15 5/374 26207
/proc/meminfo: memFree=22494864/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=116208 CPUtime=0 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 553 1262 0 0 0 0 0 0 25 0 5 0 654515122 118996992 478 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 29052 478 171 55 0 26938 0
[pid=26207/tid=26213] ppid=26205 vsize=116440 CPUtime=0 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 43 1262 0 0 0 0 0 0 25 0 5 0 654515123 119234560 518 33554432000 4194304 4417452 140736039064128 18446744073709551615 4277491 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=116336 CPUtime=0 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 1 1262 0 0 0 0 0 0 25 0 5 0 654515123 119128064 519 33554432000 4194304 4417452 140736039064128 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=116336 CPUtime=0 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 15 1262 0 0 0 0 0 0 25 0 5 0 654515123 119128064 519 33554432000 4194304 4417452 140736039064128 18446744073709551615 4327093 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=116336 CPUtime=0 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 4 1262 0 0 0 0 0 0 25 0 5 0 654515123 119128064 519 33554432000 4194304 4417452 140736039064128 18446744073709551615 212687780383 0 0 4096 17442 0 0 0 -1 3 0 0 0

[startup+0.056241 s]
/proc/loadavg: 7.80 7.93 6.15 5/374 26207
/proc/meminfo: memFree=22494864/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=117280 CPUtime=0.18 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 836 1262 0 0 18 0 0 0 25 0 5 0 654515122 120094720 761 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 29320 761 180 55 0 27206 0
[pid=26207/tid=26213] ppid=26205 vsize=117280 CPUtime=0.04 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 115 1262 0 0 4 0 0 0 25 0 5 0 654515123 120094720 761 33554432000 4194304 4417452 140736039064128 18446744073709551615 4257792 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=117280 CPUtime=0.04 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 55 1262 0 0 4 0 0 0 25 0 5 0 654515123 120094720 761 33554432000 4194304 4417452 140736039064128 18446744073709551615 4253211 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=117280 CPUtime=0.04 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 97 1262 0 0 4 0 0 0 25 0 5 0 654515123 120094720 761 33554432000 4194304 4417452 140736039064128 18446744073709551615 4358118 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=117280 CPUtime=0.04 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 38 1262 0 0 4 0 0 0 25 0 5 0 654515123 120094720 761 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 117280

[startup+0.156223 s]
/proc/loadavg: 7.80 7.93 6.15 5/374 26207
/proc/meminfo: memFree=22494864/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=117716 CPUtime=0.58 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 1054 1262 0 0 58 0 0 0 25 0 5 0 654515122 120541184 872 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 29429 872 180 55 0 27315 0
[pid=26207/tid=26213] ppid=26205 vsize=117716 CPUtime=0.14 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 115 1262 0 0 14 0 0 0 25 0 5 0 654515123 120541184 872 33554432000 4194304 4417452 140736039064128 18446744073709551615 4236613 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=117716 CPUtime=0.14 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 55 1262 0 0 14 0 0 0 25 0 5 0 654515123 120541184 872 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=117716 CPUtime=0.14 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 223 1262 0 0 14 0 0 0 25 0 5 0 654515123 120541184 872 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=117716 CPUtime=0.14 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 130 1262 0 0 14 0 0 0 25 0 5 0 654515123 120541184 872 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 117716

[startup+0.300198 s]
/proc/loadavg: 7.80 7.93 6.15 5/374 26207
/proc/meminfo: memFree=22494864/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=119724 CPUtime=1.16 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 1791 1262 0 0 116 0 0 0 25 0 5 0 654515122 122597376 1389 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 29931 1389 180 55 0 27817 0
[pid=26207/tid=26213] ppid=26205 vsize=119724 CPUtime=0.29 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 255 1262 0 0 29 0 0 0 25 0 5 0 654515123 122597376 1389 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=119724 CPUtime=0.28 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 248 1262 0 0 28 0 0 0 25 0 5 0 654515123 122597376 1389 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=119724 CPUtime=0.29 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 499 1262 0 0 29 0 0 0 25 0 5 0 654515123 122597376 1389 33554432000 4194304 4417452 140736039064128 18446744073709551615 4357595 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=119724 CPUtime=0.29 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 258 1262 0 0 29 0 0 0 25 0 5 0 654515123 122597376 1389 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 119724

[startup+0.701124 s]
/proc/loadavg: 7.80 7.93 6.15 5/374 26207
/proc/meminfo: memFree=22494864/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=120964 CPUtime=2.76 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 2857 1262 0 0 276 0 0 0 25 0 5 0 654515122 123867136 1668 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 30241 1668 180 55 0 28127 0
[pid=26207/tid=26213] ppid=26205 vsize=120964 CPUtime=0.69 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 501 1262 0 0 69 0 0 0 25 0 5 0 654515123 123867136 1668 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=120964 CPUtime=0.68 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 501 1262 0 0 68 0 0 0 25 0 5 0 654515123 123867136 1668 33554432000 4194304 4417452 140736039064128 18446744073709551615 4358093 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=120964 CPUtime=0.69 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 856 1262 0 0 69 0 0 0 25 0 5 0 654515123 123867136 1668 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=120964 CPUtime=0.69 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 468 1262 0 0 69 0 0 0 25 0 5 0 654515123 123867136 1668 33554432000 4194304 4417452 140736039064128 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 120964

[startup+1.50098 s]
/proc/loadavg: 7.80 7.93 6.15 10/379 26217
/proc/meminfo: memFree=22470148/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=124524 CPUtime=5.94 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 6121 1262 0 0 594 0 0 0 25 0 5 0 654515122 127512576 2596 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 31131 2596 180 55 0 29017 0
[pid=26207/tid=26213] ppid=26205 vsize=124524 CPUtime=1.47 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 1623 1262 0 0 147 0 0 0 25 0 5 0 654515123 127512576 2596 33554432000 4194304 4417452 140736039064128 18446744073709551615 4236935 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=124524 CPUtime=1.48 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 1208 1262 0 0 148 0 0 0 25 0 5 0 654515123 127512576 2596 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=124524 CPUtime=1.49 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 1604 1262 0 0 149 0 0 0 25 0 5 0 654515123 127512576 2596 33554432000 4194304 4417452 140736039064128 18446744073709551615 4257159 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=124524 CPUtime=1.49 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 1155 1262 0 0 149 0 0 0 25 0 5 0 654515123 127512576 2596 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 124524

[startup+3.10069 s]
/proc/loadavg: 7.80 7.93 6.15 11/379 26217
/proc/meminfo: memFree=22459484/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=126616 CPUtime=12.33 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 10926 1262 0 0 1232 1 0 0 25 0 5 0 654515122 129654784 3087 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 31654 3087 180 55 0 29540 0
[pid=26207/tid=26213] ppid=26205 vsize=126616 CPUtime=3.05 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 2701 1262 0 0 305 0 0 0 25 0 5 0 654515123 129654784 3087 33554432000 4194304 4417452 140736039064128 18446744073709551615 4354693 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=126616 CPUtime=3.08 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 2556 1262 0 0 308 0 0 0 25 0 5 0 654515123 129654784 3087 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=126616 CPUtime=3.08 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 2906 1262 0 0 308 0 0 0 25 0 5 0 654515123 129654784 3087 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=126616 CPUtime=3.08 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 2232 1262 0 0 308 0 0 0 25 0 5 0 654515123 129654784 3087 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 126616

[startup+6.30111 s]
/proc/loadavg: 7.82 7.93 6.16 10/379 26218
/proc/meminfo: memFree=22443548/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=134156 CPUtime=25.1 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 20831 1262 0 0 2507 3 0 0 25 0 5 0 654515122 137375744 4972 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 33539 4972 180 55 0 31425 0
[pid=26207/tid=26213] ppid=26205 vsize=134156 CPUtime=6.22 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 4980 1262 0 0 621 1 0 0 25 0 5 0 654515123 137375744 4972 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366090 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=134156 CPUtime=6.28 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 5147 1262 0 0 628 0 0 0 25 0 5 0 654515123 137375744 4972 33554432000 4194304 4417452 140736039064128 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=134156 CPUtime=6.28 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 5958 1262 0 0 628 0 0 0 25 0 5 0 654515123 137375744 4972 33554432000 4194304 4417452 140736039064128 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=134156 CPUtime=6.28 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 4215 1262 0 0 628 0 0 0 25 0 5 0 654515123 137375744 4972 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 134156

[startup+12.7009 s]
/proc/loadavg: 7.83 7.94 6.17 10/379 26218
/proc/meminfo: memFree=22481292/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=139328 CPUtime=50.61 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 35521 1262 0 0 5056 5 0 0 25 0 5 0 654515122 142671872 6265 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 34832 6265 180 55 0 32718 0
[pid=26207/tid=26213] ppid=26205 vsize=139328 CPUtime=12.54 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 8980 1262 0 0 1252 2 0 0 25 0 5 0 654515123 142671872 6265 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=139328 CPUtime=12.68 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 9933 1262 0 0 1267 1 0 0 25 0 5 0 654515123 142671872 6265 33554432000 4194304 4417452 140736039064128 18446744073709551615 4321005 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=139328 CPUtime=12.69 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 8865 1262 0 0 1268 1 0 0 25 0 5 0 654515123 142671872 6265 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366184 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=139328 CPUtime=12.69 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 7212 1262 0 0 1268 1 0 0 25 0 5 0 654515123 142671872 6265 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 139328

[startup+25.5006 s]
/proc/loadavg: 7.87 7.94 6.20 10/379 26218
/proc/meminfo: memFree=22419404/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=146708 CPUtime=101.66 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 59876 1262 0 0 10158 8 0 0 25 0 5 0 654515122 150228992 8134 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 36677 8134 180 55 0 34563 0
[pid=26207/tid=26213] ppid=26205 vsize=146708 CPUtime=25.18 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 14771 1262 0 0 2516 2 0 0 25 0 5 0 654515123 150228992 8134 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=146708 CPUtime=25.48 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 16770 1262 0 0 2546 2 0 0 25 0 5 0 654515123 150228992 8134 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364619 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=146708 CPUtime=25.48 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 15088 1262 0 0 2547 1 0 0 25 0 5 0 654515123 150228992 8134 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=146708 CPUtime=25.48 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 12716 1262 0 0 2547 1 0 0 25 0 5 0 654515123 150228992 8134 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.66
Current children cumulated vsize (KiB) 146708

[startup+51.1009 s]
/proc/loadavg: 8.06 7.97 6.26 10/379 26219
/proc/meminfo: memFree=22445808/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=159884 CPUtime=203.77 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 97196 1262 0 0 20362 15 0 0 25 0 5 0 654515122 163721216 11404 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 39971 11404 180 55 0 37857 0
[pid=26207/tid=26213] ppid=26205 vsize=159884 CPUtime=50.48 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 26231 1262 0 0 5044 4 0 0 25 0 5 0 654515123 163721216 11404 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=159884 CPUtime=51.08 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 25001 1262 0 0 5105 3 0 0 25 0 5 0 654515123 163721216 11404 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=159884 CPUtime=51.08 cores=1,3,5,7

################
# More data... #
################

[pid=26207/tid=26214] ppid=26205 vsize=248176 CPUtime=702.3 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 183144 1262 0 0 70203 27 0 0 25 0 5 0 654515123 254132224 33477 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=248176 CPUtime=702.3 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 172997 1262 0 0 70203 27 0 0 25 0 5 0 654515123 254132224 33477 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=248176 CPUtime=702.3 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 153917 1262 0 0 70207 23 0 0 25 0 5 0 654515123 254132224 33477 33554432000 4194304 4417452 140736039064128 18446744073709551615 4356878 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2800.94
Current children cumulated vsize (KiB) 248176

[startup+762.314 s]
/proc/loadavg: 8.07 8.08 7.22 9/379 26275
/proc/meminfo: memFree=22151844/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=247812 CPUtime=3040.28 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 685569 1262 0 0 303920 108 0 0 25 0 5 0 654515122 253759488 33413 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 61953 33413 180 55 0 59839 0
[pid=26207/tid=26213] ppid=26205 vsize=247812 CPUtime=753.29 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 145886 1262 0 0 75306 23 0 0 25 0 5 0 654515123 253759488 33413 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=247812 CPUtime=762.32 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 194497 1262 0 0 76203 29 0 0 25 0 5 0 654515123 253759488 33413 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=247812 CPUtime=762.32 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 180820 1262 0 0 76203 29 0 0 25 0 5 0 654515123 253759488 33413 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=247812 CPUtime=762.32 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 163835 1262 0 0 76207 25 0 0 25 0 5 0 654515123 253759488 33413 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3040.28
Current children cumulated vsize (KiB) 247812

[startup+822.3 s]
/proc/loadavg: 8.14 8.09 7.28 9/379 26276
/proc/meminfo: memFree=22088220/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=266868 CPUtime=3279.53 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 719566 1262 0 0 327839 114 0 0 25 0 5 0 654515122 273272832 38150 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 66717 38150 180 55 0 64603 0
[pid=26207/tid=26213] ppid=26205 vsize=266868 CPUtime=812.58 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 151999 1262 0 0 81234 24 0 0 25 0 5 0 654515123 273272832 38150 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=266868 CPUtime=822.3 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 202606 1262 0 0 82200 30 0 0 25 0 5 0 654515123 273272832 38150 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=266868 CPUtime=822.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 192346 1262 0 0 82200 31 0 0 25 0 5 0 654515123 273272832 38150 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=266868 CPUtime=822.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 172084 1262 0 0 82204 27 0 0 25 0 5 0 654515123 273272832 38150 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3279.53
Current children cumulated vsize (KiB) 266868

[startup+882.3 s]
/proc/loadavg: 8.05 8.07 7.32 9/379 26278
/proc/meminfo: memFree=22073200/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=253924 CPUtime=3518.82 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 753592 1262 0 0 351763 119 0 0 25 0 5 0 654515122 260018176 34914 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 63481 34914 180 55 0 61367 0
[pid=26207/tid=26213] ppid=26205 vsize=253924 CPUtime=871.87 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 159693 1262 0 0 87161 26 0 0 25 0 5 0 654515123 260018176 34914 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=253924 CPUtime=882.3 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 212938 1262 0 0 88198 32 0 0 25 0 5 0 654515123 260018176 34914 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=253924 CPUtime=882.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 200842 1262 0 0 88199 32 0 0 25 0 5 0 654515123 260018176 34914 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=253924 CPUtime=882.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 179588 1262 0 0 88203 28 0 0 25 0 5 0 654515123 260018176 34914 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3518.82
Current children cumulated vsize (KiB) 253924

[startup+942.3 s]
/proc/loadavg: 8.12 8.09 7.37 9/379 26279
/proc/meminfo: memFree=22050620/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=252784 CPUtime=3758.12 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 789208 1262 0 0 375687 125 0 0 25 0 5 0 654515122 258850816 34629 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 63196 34629 180 55 0 61082 0
[pid=26207/tid=26213] ppid=26205 vsize=252784 CPUtime=931.17 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 167451 1262 0 0 93090 27 0 0 25 0 5 0 654515123 258850816 34629 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=252784 CPUtime=942.3 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 219147 1262 0 0 94197 33 0 0 25 0 5 0 654515123 258850816 34629 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=252784 CPUtime=942.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 213174 1262 0 0 94197 34 0 0 25 0 5 0 654515123 258850816 34629 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=252784 CPUtime=942.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 188905 1262 0 0 94201 30 0 0 25 0 5 0 654515123 258850816 34629 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3758.12
Current children cumulated vsize (KiB) 252784

[startup+1002.3 s]
/proc/loadavg: 8.18 8.10 7.42 9/379 26281
/proc/meminfo: memFree=22018124/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=259420 CPUtime=3997.42 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 822609 1262 0 0 399611 131 0 0 25 0 5 0 654515122 265646080 36288 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 64855 36288 180 55 0 62741 0
[pid=26207/tid=26213] ppid=26205 vsize=259420 CPUtime=990.45 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 175168 1262 0 0 99017 28 0 0 25 0 5 0 654515123 265646080 36288 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=259420 CPUtime=1002.3 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 228650 1262 0 0 100196 34 0 0 25 0 5 0 654515123 265646080 36288 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365768 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=259420 CPUtime=1002.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 222946 1262 0 0 100195 36 0 0 25 0 5 0 654515123 265646080 36288 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=259420 CPUtime=1002.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 195314 1262 0 0 100200 31 0 0 25 0 5 0 654515123 265646080 36288 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3997.42
Current children cumulated vsize (KiB) 259420

[startup+1062.3 s]
/proc/loadavg: 8.12 8.10 7.46 9/379 26283
/proc/meminfo: memFree=22060140/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=247004 CPUtime=4236.72 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 856163 1262 0 0 423536 136 0 0 25 0 5 0 654515122 252932096 33184 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 61751 33184 180 55 0 59637 0
[pid=26207/tid=26213] ppid=26205 vsize=247004 CPUtime=1049.75 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 182693 1262 0 0 104945 30 0 0 25 0 5 0 654515123 252932096 33184 33554432000 4194304 4417452 140736039064128 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=247004 CPUtime=1062.31 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 236559 1262 0 0 106196 35 0 0 25 0 5 0 654515123 252932096 33184 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=247004 CPUtime=1062.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 231915 1262 0 0 106194 37 0 0 25 0 5 0 654515123 252932096 33184 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=247004 CPUtime=1062.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 204465 1262 0 0 106199 32 0 0 25 0 5 0 654515123 252932096 33184 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4236.72
Current children cumulated vsize (KiB) 247004

[startup+1122.3 s]
/proc/loadavg: 8.16 8.11 7.50 9/379 26284
/proc/meminfo: memFree=21990444/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=267292 CPUtime=4476 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 885728 1262 0 0 447460 140 0 0 25 0 5 0 654515122 273707008 38256 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 66823 38256 180 55 0 64709 0
[pid=26207/tid=26213] ppid=26205 vsize=267292 CPUtime=1109.02 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 191295 1262 0 0 110871 31 0 0 25 0 5 0 654515123 273707008 38256 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=267292 CPUtime=1122.31 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 243699 1262 0 0 112195 36 0 0 25 0 5 0 654515123 273707008 38256 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=267292 CPUtime=1122.32 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 239076 1262 0 0 112194 38 0 0 25 0 5 0 654515123 273707008 38256 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=267292 CPUtime=1122.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 211127 1262 0 0 112198 33 0 0 25 0 5 0 654515123 273707008 38256 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4476
Current children cumulated vsize (KiB) 267292

[startup+1182.3 s]
/proc/loadavg: 8.17 8.12 7.54 9/379 26286
/proc/meminfo: memFree=21847580/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=314832 CPUtime=4715.3 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 920774 1262 0 0 471385 145 0 0 25 0 5 0 654515122 322387968 50141 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 78708 50141 180 55 0 76594 0
[pid=26207/tid=26213] ppid=26205 vsize=314832 CPUtime=1168.32 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 197880 1262 0 0 116800 32 0 0 25 0 5 0 654515123 322387968 50141 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=314832 CPUtime=1182.31 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 248694 1262 0 0 118194 37 0 0 25 0 5 0 654515123 322387968 50141 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=314832 CPUtime=1182.31 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 250829 1262 0 0 118192 39 0 0 25 0 5 0 654515123 322387968 50141 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=314832 CPUtime=1182.31 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 222840 1262 0 0 118197 34 0 0 25 0 5 0 654515123 322387968 50141 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4715.3
Current children cumulated vsize (KiB) 314832



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.12 8.11 7.55 9/379 26286
/proc/meminfo: memFree=21891844/32951124 swapFree=67111348/67111528
[pid=26207] ppid=26205 vsize=269852 CPUtime=4800.26 cores=1,3,5,7
/proc/26207/stat : 26207 (plingeling) S 26205 26207 26007 0 -1 4202496 933665 1262 0 0 479880 146 0 0 25 0 5 0 654515122 276328448 38896 33554432000 4194304 4417452 140736039064128 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/26207/statm: 67463 38896 180 55 0 65349 0
[pid=26207/tid=26213] ppid=26205 vsize=269852 CPUtime=1189.36 cores=1,3,5,7
/proc/26207/task/26213/stat : 26213 (plingeling) R 26205 26207 26007 0 -1 4202560 200811 1262 0 0 118903 33 0 0 25 0 5 0 654515123 276328448 38896 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26207/tid=26214] ppid=26205 vsize=269852 CPUtime=1203.63 cores=1,3,5,7
/proc/26207/task/26214/stat : 26214 (plingeling) R 26205 26207 26007 0 -1 4202560 253541 1262 0 0 120325 38 0 0 25 0 5 0 654515123 276328448 38896 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26207/tid=26215] ppid=26205 vsize=269852 CPUtime=1203.64 cores=1,3,5,7
/proc/26207/task/26215/stat : 26215 (plingeling) R 26205 26207 26007 0 -1 4202560 253111 1262 0 0 120324 40 0 0 25 0 5 0 654515123 276328448 38896 33554432000 4194304 4417452 140736039064128 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26207/tid=26216] ppid=26205 vsize=269852 CPUtime=1203.64 cores=1,3,5,7
/proc/26207/task/26216/stat : 26216 (plingeling) R 26205 26207 26007 0 -1 4202560 225671 1262 0 0 120329 35 0 0 25 0 5 0 654515123 276328448 38896 33554432000 4194304 4417452 140736039064128 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 269852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.63
CPU time (s): 4800.32
CPU user time (s): 4798.84
CPU system time (s): 1.47878
CPU usage (%): 398.821
Max. virtual memory (cumulated for all children) (KiB): 321112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.84
system time used= 1.47877
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 934927
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 88
involuntary context switches= 32083

runsolver used 3.9074 second user time and 10.3854 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-15 05:12:54
IDJOB=3371477
IDBENCH=83431
IDSOLVER=1848
FILE ID=node139/3371477-1305429174
RUNJOBID= node139-1305427968-26026
PBS_JOBID= 13324610
Free space on /tmp= 73408 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/32/aes_32_4_keyfind_1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371477-1305429174/watcher-3371477-1305429174 -o /tmp/evaluation-result-3371477-1305429174/solver-3371477-1305429174 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371477-1305429174.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d71ab4cbe872e5620884d4e4d370890a
RANDOM SEED=1498337000

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22495144 kB
Buffers:        304152 kB
Cached:        2860388 kB
SwapCached:          0 kB
Active:        8131884 kB
Inactive:      2020040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22495144 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:              52 kB
Writeback:           0 kB
AnonPages:     6987004 kB
Mapped:          29212 kB
Slab:           202160 kB
PageTables:      38580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 76973856 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73408 MiB
End job on node139 at 2011-05-15 05:33:00