Trace number 3309834

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.8 5004.1

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom18.cnf
MD5SUM9ece8f569c93ceee834817ef3350ed8e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables36410
Number of clauses121578
Sum of the clauses size309786
Maximum clause length1188
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 262692
Number of clauses of size 358247
Number of clauses of size 4170
Number of clauses of size 516
Number of clauses of size over 5452

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309834-1307665369/watcher-3309834-1307665369 -o /tmp/evaluation-result-3309834-1307665369/solver-3309834-1307665369 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309834-1307665369.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 1.30 1.68 1/170 7337
/proc/meminfo: memFree=32269204/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=8728 CPUtime=0 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 216 0 0 0 0 0 0 0 25 0 1 0 858952358 8937472 146 33554432000 4194304 4417332 140734683313504 18446744073709551615 228095450880 0 0 4096 0 18446744071562362840 0 0 17 5 0 0 0
/proc/7337/statm: 2182 146 122 55 0 68 0

[startup+0.019355 s]
/proc/loadavg: 0.92 1.30 1.68 1/170 7337
/proc/meminfo: memFree=32269204/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=8728 CPUtime=0 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 216 0 0 0 0 0 0 0 25 0 1 0 858952358 8937472 146 33554432000 4194304 4417332 140734683313504 18446744073709551615 228095450880 0 0 4096 0 18446744071562362840 0 0 17 5 0 0 0
/proc/7337/statm: 2182 146 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.10032 s]
/proc/loadavg: 0.92 1.30 1.68 1/170 7337
/proc/meminfo: memFree=32269204/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=29628 CPUtime=0.06 cores=0-7
/proc/7337/stat : 7337 (plingeling) R 7335 7337 7307 0 -1 4202496 5469 1258 0 2 6 0 0 0 25 0 1 0 858952358 30339072 5398 33554432000 4194304 4417332 140734683313504 18446744073709551615 4231494 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7337/statm: 7407 5398 148 55 0 5293 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 29628

[startup+0.300285 s]
/proc/loadavg: 0.92 1.30 1.68 1/170 7337
/proc/meminfo: memFree=32269204/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=81212 CPUtime=0.26 cores=0-7
/proc/7337/stat : 7337 (plingeling) R 7335 7337 7307 0 -1 4202496 18381 1258 0 2 24 2 0 0 25 0 1 0 858952358 83161088 18310 33554432000 4194304 4417332 140734683313504 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/7337/statm: 20303 18310 148 55 0 18189 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 81212

[startup+0.700178 s]
/proc/loadavg: 0.92 1.30 1.68 1/170 7337
/proc/meminfo: memFree=32269204/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=221460 CPUtime=3.2 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 31650 1258 0 2 316 4 0 0 18 0 9 0 858952358 226775040 18418 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 55365 18418 175 55 0 53251 0
Current children cumulated CPU time (s) 3.2
Current children cumulated vsize (KiB) 221460

[startup+1.50103 s]
/proc/loadavg: 0.92 1.30 1.68 9/179 7351
/proc/meminfo: memFree=32189984/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=220088 CPUtime=9.59 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 38187 1258 0 2 954 5 0 0 18 0 9 0 858952358 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 55022 19230 175 55 0 52908 0
[pid=7337/tid=7344] ppid=7335 vsize=220088 CPUtime=1.17 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 910 1258 0 2 117 0 0 0 19 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4284626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=220088 CPUtime=1.16 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 1612 1258 0 2 116 0 0 0 25 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=220088 CPUtime=1.16 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 1399 1258 0 2 116 0 0 0 19 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4268511 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=220088 CPUtime=1.16 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 718 1258 0 2 116 0 0 0 19 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=220088 CPUtime=1.16 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 6550 1258 0 2 116 0 0 0 19 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=220088 CPUtime=1.15 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 4233 1258 0 2 115 0 0 0 19 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=220088 CPUtime=1.13 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 2100 1258 0 2 113 0 0 0 22 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4290917 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=220088 CPUtime=1.15 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 2268 1258 0 2 115 0 0 0 22 0 9 0 858952391 225370112 19230 33554432000 4194304 4417332 140734683313504 18446744073709551615 4306607 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.59
Current children cumulated vsize (KiB) 220088

[startup+3.10073 s]
/proc/loadavg: 0.92 1.30 1.68 9/179 7351
/proc/meminfo: memFree=32185272/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=229560 CPUtime=22.38 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 48705 1258 0 2 2232 6 0 0 18 0 9 0 858952358 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 57390 20493 181 55 0 55276 0
[pid=7337/tid=7344] ppid=7335 vsize=229560 CPUtime=2.76 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 1543 1258 0 2 276 0 0 0 23 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4252491 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=229560 CPUtime=2.75 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 5062 1258 0 2 275 0 0 0 25 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4272829 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=229560 CPUtime=2.76 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 1850 1258 0 2 276 0 0 0 23 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364385 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=229560 CPUtime=2.76 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 718 1258 0 2 276 0 0 0 23 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=229560 CPUtime=2.75 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 8567 1258 0 2 275 0 0 0 23 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4252140 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=229560 CPUtime=2.75 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 6122 1258 0 2 275 0 0 0 23 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=229560 CPUtime=2.73 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 3327 1258 0 2 273 0 0 0 25 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=229560 CPUtime=2.74 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 3119 1258 0 2 274 0 0 0 25 0 9 0 858952391 235069440 20493 33554432000 4194304 4417332 140734683313504 18446744073709551615 4252121 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.38
Current children cumulated vsize (KiB) 229560

[startup+6.30115 s]
/proc/loadavg: 1.49 1.42 1.71 9/179 7351
/proc/meminfo: memFree=32175724/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=243868 CPUtime=47.97 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 52791 1258 0 2 4790 7 0 0 18 0 9 0 858952358 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 60967 24358 181 55 0 58853 0
[pid=7337/tid=7344] ppid=7335 vsize=243868 CPUtime=5.97 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 2064 1258 0 2 597 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=243868 CPUtime=5.95 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 5199 1258 0 2 595 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364504 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=243868 CPUtime=5.96 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 3309 1258 0 2 596 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4296272 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=243868 CPUtime=5.96 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 1036 1258 0 2 596 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=243868 CPUtime=5.96 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 9080 1258 0 2 595 1 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365033 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=243868 CPUtime=5.95 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 6257 1258 0 2 595 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=243868 CPUtime=5.93 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 3735 1258 0 2 593 0 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=243868 CPUtime=5.93 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 3714 1258 0 2 592 1 0 0 25 0 9 0 858952391 249720832 24358 33554432000 4194304 4417332 140734683313504 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 47.97
Current children cumulated vsize (KiB) 243868

[startup+12.701 s]
/proc/loadavg: 2.01 1.52 1.74 9/179 7351
/proc/meminfo: memFree=32150468/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=268700 CPUtime=99.13 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 59094 1258 0 2 9905 8 0 0 18 0 9 0 858952358 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 67175 30593 181 55 0 65061 0
[pid=7337/tid=7344] ppid=7335 vsize=268700 CPUtime=12.36 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 2071 1258 0 2 1236 0 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=268700 CPUtime=12.35 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 5629 1258 0 2 1235 0 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=268700 CPUtime=12.36 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 4125 1258 0 2 1236 0 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=268700 CPUtime=12.36 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 4011 1258 0 2 1236 0 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=268700 CPUtime=12.36 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 9644 1258 0 2 1235 1 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4236816 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=268700 CPUtime=12.36 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 6557 1258 0 2 1235 1 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4366066 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=268700 CPUtime=12.33 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 4937 1258 0 2 1233 0 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=268700 CPUtime=12.3 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 3723 1258 0 2 1229 1 0 0 25 0 9 0 858952391 275148800 30593 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.13
Current children cumulated vsize (KiB) 268700

[startup+25.5006 s]
/proc/loadavg: 3.34 1.84 1.84 9/179 7352
/proc/meminfo: memFree=32120812/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=298036 CPUtime=201.46 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 73531 1258 0 2 20135 11 0 0 18 0 9 0 858952358 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 74509 37912 181 55 0 72395 0
[pid=7337/tid=7344] ppid=7335 vsize=298036 CPUtime=25.16 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 2675 1258 0 2 2516 0 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4237278 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=298036 CPUtime=25.15 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 6885 1258 0 2 2515 0 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4310471 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=298036 CPUtime=25.16 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 4535 1258 0 2 2516 0 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365045 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=298036 CPUtime=25.16 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 10063 1258 0 2 2515 1 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365045 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=298036 CPUtime=25.16 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 10020 1258 0 2 2515 1 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=298036 CPUtime=25.15 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 10049 1258 0 2 2514 1 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=298036 CPUtime=25.14 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 5722 1258 0 2 2513 1 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=298036 CPUtime=25.02 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 5185 1258 0 2 2501 1 0 0 25 0 9 0 858952391 305188864 37912 33554432000 4194304 4417332 140734683313504 18446744073709551615 4309653 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.46
Current children cumulated vsize (KiB) 298036

[startup+51.1009 s]
/proc/loadavg: 4.93 2.33 2.00 9/179 7352
/proc/meminfo: memFree=32099616/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=317376 CPUtime=406.13 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 111254 1258 0 2 40595 18 0 0 18 0 9 0 858952358 324993024 42747 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 79344 42747 181 55 0 77230 0
[pid=7337/tid=7344] ppid=7335 vsize=317376 CPUtime=50.76 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 7906 1258 0 2 5075 1 0 0 25 0 9 0 858952391 324993024 42747 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365033 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=317376 CPUtime=50.75 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 12005 1258 0 2 5074 1 0 0 25 0 9 0 858952391 324993024 42747 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364383 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=317376 CPUtime=50.76 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.00 8.04 7.99 9/179 7492
/proc/meminfo: memFree=28329600/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4076996 CPUtime=37749.2 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4484370 1258 0 2 3774066 853 0 0 18 0 9 0 858952358 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1019249 982621 181 55 0 1017135 0
[pid=7337/tid=7344] ppid=7335 vsize=4076996 CPUtime=4721.81 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 575693 1258 0 2 472061 120 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4076996 CPUtime=4721.96 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 538422 1258 0 2 472089 107 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4076996 CPUtime=4722.09 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 516278 1258 0 2 472118 91 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4076996 CPUtime=4721.44 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 583197 1258 0 2 472048 96 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4076996 CPUtime=4720.99 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 538481 1258 0 2 471988 111 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4076996 CPUtime=4722.1 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 453126 1258 0 2 472136 74 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4076996 CPUtime=4722.08 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 658913 1258 0 2 472065 143 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4076996 CPUtime=4696.35 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 601863 1258 0 2 469531 104 0 0 25 0 9 0 858952391 4174843904 982621 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37749.2
Current children cumulated vsize (KiB) 4076996

[startup+4782.3 s]
/proc/loadavg: 8.00 8.03 7.99 9/179 7494
/proc/meminfo: memFree=27807536/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4598748 CPUtime=38228.8 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4700318 1258 0 2 3821987 894 0 0 18 0 9 0 858952358 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1149687 1113058 181 55 0 1147573 0
[pid=7337/tid=7344] ppid=7335 vsize=4598748 CPUtime=4781.81 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 628303 1258 0 2 478053 128 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4598748 CPUtime=4781.95 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 538422 1258 0 2 478088 107 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4598748 CPUtime=4782.09 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 529393 1258 0 2 478115 94 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4598748 CPUtime=4781.45 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 597039 1258 0 2 478045 100 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4598748 CPUtime=4780.98 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 598451 1258 0 2 477977 121 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4598748 CPUtime=4782.09 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 508700 1258 0 2 478121 88 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4598748 CPUtime=4782.06 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 679750 1258 0 2 478059 147 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4598748 CPUtime=4756.02 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 601863 1258 0 2 475498 104 0 0 25 0 9 0 858952391 4709117952 1113058 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38228.8
Current children cumulated vsize (KiB) 4598748

[startup+4842.3 s]
/proc/loadavg: 8.00 8.02 7.99 9/179 7495
/proc/meminfo: memFree=28121600/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4285612 CPUtime=38708.5 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4738086 1258 0 2 3869947 901 0 0 18 0 9 0 858952358 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1071403 1034774 181 55 0 1069289 0
[pid=7337/tid=7344] ppid=7335 vsize=4285612 CPUtime=4841.81 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 628303 1258 0 2 484053 128 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4285612 CPUtime=4841.95 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 538430 1258 0 2 484088 107 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4285612 CPUtime=4842.1 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 544991 1258 0 2 484113 97 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4285612 CPUtime=4841.45 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 597039 1258 0 2 484045 100 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4285612 CPUtime=4840.98 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 598451 1258 0 2 483977 121 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4285612 CPUtime=4842.1 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 508700 1258 0 2 484122 88 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4285612 CPUtime=4842.06 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 679750 1258 0 2 484059 147 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4285612 CPUtime=4815.69 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 624025 1258 0 2 481461 108 0 0 25 0 9 0 858952391 4388466688 1034774 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38708.5
Current children cumulated vsize (KiB) 4285612

[startup+4902.3 s]
/proc/loadavg: 8.00 8.02 7.99 9/179 7497
/proc/meminfo: memFree=27973384/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4433288 CPUtime=39188.2 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4795112 1258 0 2 3917902 915 0 0 18 0 9 0 858952358 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1108322 1071714 181 55 0 1106208 0
[pid=7337/tid=7344] ppid=7335 vsize=4433288 CPUtime=4901.81 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 628303 1258 0 2 490053 128 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4433288 CPUtime=4901.95 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 538430 1258 0 2 490088 107 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4433288 CPUtime=4902.1 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 545012 1258 0 2 490113 97 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4433288 CPUtime=4901.45 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 597039 1258 0 2 490045 100 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4433288 CPUtime=4900.98 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 631219 1258 0 2 489967 131 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4433288 CPUtime=4902.1 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 508700 1258 0 2 490122 88 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4433288 CPUtime=4902.06 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 679750 1258 0 2 490059 147 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4433288 CPUtime=4875.36 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 648262 1258 0 2 487425 111 0 0 25 0 9 0 858952391 4539686912 1071714 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39188.2
Current children cumulated vsize (KiB) 4433288

[startup+4962.3 s]
/proc/loadavg: 8.00 8.01 7.99 9/179 7498
/proc/meminfo: memFree=27908872/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4497148 CPUtime=39667.9 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4901382 1258 0 2 3965845 940 0 0 18 0 9 0 858952358 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1124287 1087689 181 55 0 1122173 0
[pid=7337/tid=7344] ppid=7335 vsize=4497148 CPUtime=4961.81 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 628303 1258 0 2 496053 128 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4497148 CPUtime=4961.95 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 571198 1258 0 2 496078 117 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4497148 CPUtime=4962.1 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 545012 1258 0 2 496113 97 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4497148 CPUtime=4961.45 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 608119 1258 0 2 496042 103 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4355764 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4497148 CPUtime=4960.97 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 693641 1258 0 2 495953 144 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4497148 CPUtime=4962.1 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 508700 1258 0 2 496122 88 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4497148 CPUtime=4962.07 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 679750 1258 0 2 496060 147 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4497148 CPUtime=4935.03 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 648262 1258 0 2 493392 111 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39667.8
Current children cumulated vsize (KiB) 4497148



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.91 s]
/proc/loadavg: 8.06 8.02 8.00 9/179 7499
/proc/meminfo: memFree=27908724/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=4497148 CPUtime=40000.5 cores=0-7
/proc/7337/stat : 7337 (plingeling) S 7335 7337 7307 0 -1 4202496 4901382 1258 0 2 3999112 940 0 0 18 0 9 0 858952358 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 1124287 1087689 181 55 0 1122173 0
[pid=7337/tid=7344] ppid=7335 vsize=4497148 CPUtime=5003.43 cores=0-7
/proc/7337/task/7344/stat : 7344 (plingeling) R 7335 7337 7307 0 -1 4202560 628303 1258 0 2 500215 128 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=7337/tid=7345] ppid=7335 vsize=4497148 CPUtime=5003.57 cores=0-7
/proc/7337/task/7345/stat : 7345 (plingeling) R 7335 7337 7307 0 -1 4202560 571198 1258 0 2 500240 117 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7337/tid=7346] ppid=7335 vsize=4497148 CPUtime=5003.71 cores=0-7
/proc/7337/task/7346/stat : 7346 (plingeling) R 7335 7337 7307 0 -1 4202560 545012 1258 0 2 500274 97 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7337/tid=7347] ppid=7335 vsize=4497148 CPUtime=5003.06 cores=0-7
/proc/7337/task/7347/stat : 7347 (plingeling) R 7335 7337 7307 0 -1 4202560 608119 1258 0 2 500203 103 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=7337/tid=7348] ppid=7335 vsize=4497148 CPUtime=5002.58 cores=0-7
/proc/7337/task/7348/stat : 7348 (plingeling) R 7335 7337 7307 0 -1 4202560 693641 1258 0 2 500114 144 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=7337/tid=7349] ppid=7335 vsize=4497148 CPUtime=5003.71 cores=0-7
/proc/7337/task/7349/stat : 7349 (plingeling) R 7335 7337 7307 0 -1 4202560 508700 1258 0 2 500283 88 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=7337/tid=7350] ppid=7335 vsize=4497148 CPUtime=5003.68 cores=0-7
/proc/7337/task/7350/stat : 7350 (plingeling) R 7335 7337 7307 0 -1 4202560 679750 1258 0 2 500221 147 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=4497148 CPUtime=4976.41 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4202560 648262 1258 0 2 497530 111 0 0 25 0 9 0 858952391 4605079552 1087689 33554432000 4194304 4417332 140734683313504 18446744073709551615 4364289 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 4497148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5004.01 s]
/proc/loadavg: 8.06 8.02 8.00 9/179 7499
/proc/meminfo: memFree=27908724/32951124 swapFree=67053960/67111528
[pid=7337] ppid=7335 vsize=0 CPUtime=40000.7 cores=0-7
/proc/7337/stat : 7337 (plingeling) Z 7335 7337 7307 0 -1 4203548 4901382 1258 0 2 3999116 950 0 0 18 0 2 0 858952358 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/7337/statm: 0 0 0 0 0 0 0
[pid=7337/tid=7351] ppid=7335 vsize=0 CPUtime=4976.52 cores=0-7
/proc/7337/task/7351/stat : 7351 (plingeling) R 7335 7337 7307 0 -1 4203588 648262 1258 0 2 497531 121 0 0 25 0 2 0 858952391 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.1
CPU time (s): 40000.8
CPU user time (s): 39991.2
CPU system time (s): 9.59054
CPU usage (%): 799.36
Max. virtual memory (cumulated for all children) (KiB): 4598748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39991.2
system time used= 9.59054
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4902640
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 457
involuntary context switches= 193582

runsolver used 8.08477 second user time and 19.2071 second system time

The end

Launcher Data 

Begin job on node142 at 2011-06-10 02:22:49
IDJOB=3309834
IDBENCH=83127
IDSOLVER=1695
FILE ID=node142/3309834-1307665369
RUNJOBID= node142-1307665369-7321
PBS_JOBID= 13549440
Free space on /tmp= 74148 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom18.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309834-1307665369/watcher-3309834-1307665369 -o /tmp/evaluation-result-3309834-1307665369/solver-3309834-1307665369 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309834-1307665369.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9ece8f569c93ceee834817ef3350ed8e
RANDOM SEED=524675742

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32269500 kB
Buffers:        124400 kB
Cached:         366268 kB
SwapCached:      11412 kB
Active:         227424 kB
Inactive:       282228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32269500 kB
SwapTotal:    67111528 kB
SwapFree:     67053960 kB
Dirty:            2360 kB
Writeback:           0 kB
AnonPages:       16288 kB
Mapped:          11752 kB
Slab:           105604 kB
PageTables:       4260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   182820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74144 MiB
End job on node142 at 2011-06-10 03:46:15