Trace number 3372665

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5009.03

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom26.cnf
MD5SUM98fee1752ddf8cd7cd77925ecf4bfe6e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables73074
Number of clauses245746
Sum of the clauses size628346
Maximum clause length2232
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2124096
Number of clauses of size 3120415
Number of clauses of size 4350
Number of clauses of size 524
Number of clauses of size over 5860

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372665-1305439815/watcher-3372665-1305439815 -o /tmp/evaluation-result-3372665-1305439815/solver-3372665-1305439815 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372665-1305439815.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 7.73 7.51 1/348 24238
/proc/meminfo: memFree=21510876/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=26008 CPUtime=0 cores=0-7
/proc/24238/stat : 24238 (plingeling) R 24236 24238 23933 0 -1 4202496 4560 1257 0 0 0 0 0 0 20 0 1 0 655581123 26632192 4490 33554432000 4194304 4417452 140734288465968 18446744073709551615 210646840413 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24238/statm: 6502 4504 141 55 0 4388 0

[startup+0.050341 s]
/proc/loadavg: 7.93 7.73 7.51 1/348 24238
/proc/meminfo: memFree=21510876/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=36448 CPUtime=0.04 cores=0-7
/proc/24238/stat : 24238 (plingeling) R 24236 24238 23933 0 -1 4202496 7238 1257 0 0 4 0 0 0 20 0 1 0 655581123 37322752 7136 33554432000 4194304 4417452 140734288465968 18446744073709551615 4232617 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24238/statm: 9112 7136 149 55 0 6998 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36448

[startup+0.100332 s]
/proc/loadavg: 7.93 7.73 7.51 1/348 24238
/proc/meminfo: memFree=21510876/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=48892 CPUtime=0.08 cores=0-7
/proc/24238/stat : 24238 (plingeling) R 24236 24238 23933 0 -1 4202496 10298 1257 0 0 8 0 0 0 20 0 1 0 655581123 50065408 10196 33554432000 4194304 4417452 140734288465968 18446744073709551615 210646840301 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24238/statm: 12223 10229 149 55 0 10109 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 48892

[startup+0.300301 s]
/proc/loadavg: 7.93 7.73 7.51 1/348 24238
/proc/meminfo: memFree=21510876/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=89760 CPUtime=0.28 cores=0-7
/proc/24238/stat : 24238 (plingeling) R 24236 24238 23933 0 -1 4202496 20566 1257 0 0 27 1 0 0 21 0 1 0 655581123 91914240 20464 33554432000 4194304 4417452 140734288465968 18446744073709551615 210646765024 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24238/statm: 22440 20464 149 55 0 20326 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 89760

[startup+0.700201 s]
/proc/loadavg: 7.93 7.73 7.51 1/348 24238
/proc/meminfo: memFree=21510876/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=295516 CPUtime=1.25 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 50763 1257 0 0 120 5 0 0 18 0 9 0 655581123 302608384 36560 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 73879 36560 171 55 0 71765 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 295516

[startup+1.50107 s]
/proc/loadavg: 7.93 7.73 7.51 9/357 24252
/proc/meminfo: memFree=21363500/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=287480 CPUtime=7.65 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 67602 1257 0 0 758 7 0 0 18 0 9 0 655581123 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 71870 37590 175 55 0 69756 0
[pid=24238/tid=24245] ppid=24236 vsize=287480 CPUtime=0.88 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 4760 1257 0 0 88 0 0 0 19 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4284626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=287480 CPUtime=0.88 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 2894 1257 0 0 88 0 0 0 25 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=287480 CPUtime=0.85 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 7120 1257 0 0 84 1 0 0 25 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4286350 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=287480 CPUtime=0.88 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 1258 1257 0 0 88 0 0 0 21 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=287480 CPUtime=0.88 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 5080 1257 0 0 88 0 0 0 19 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=287480 CPUtime=0.87 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 2905 1257 0 0 87 0 0 0 21 0 9 0 655581184 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4284626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=287480 CPUtime=0.87 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 2734 1257 0 0 87 0 0 0 19 0 9 0 655581185 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=287480 CPUtime=0.87 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 4777 1257 0 0 87 0 0 0 19 0 9 0 655581185 294379520 37590 33554432000 4194304 4417452 140734288465968 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.65
Current children cumulated vsize (KiB) 287480

[startup+3.1008 s]
/proc/loadavg: 7.93 7.73 7.51 9/357 24252
/proc/meminfo: memFree=21360048/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=286592 CPUtime=20.4 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 94752 1257 0 0 2029 11 0 0 18 0 9 0 655581123 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 71648 37253 178 55 0 69534 0
[pid=24238/tid=24245] ppid=24236 vsize=286592 CPUtime=2.48 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 11019 1257 0 0 247 1 0 0 22 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4255662 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=286592 CPUtime=2.47 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 7952 1257 0 0 247 0 0 0 25 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4261363 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=286592 CPUtime=2.43 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 12256 1257 0 0 242 1 0 0 25 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4346390 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=286592 CPUtime=2.46 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 1258 1257 0 0 246 0 0 0 25 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=286592 CPUtime=2.47 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 6439 1257 0 0 247 0 0 0 22 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=286592 CPUtime=2.46 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 6420 1257 0 0 245 1 0 0 25 0 9 0 655581184 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=286592 CPUtime=2.47 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 4409 1257 0 0 247 0 0 0 22 0 9 0 655581185 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4346453 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=286592 CPUtime=2.47 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 8925 1257 0 0 246 1 0 0 22 0 9 0 655581185 293470208 37253 33554432000 4194304 4417452 140734288465968 18446744073709551615 4264478 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20.4
Current children cumulated vsize (KiB) 286592

[startup+6.30125 s]
/proc/loadavg: 7.94 7.74 7.51 9/357 24252
/proc/meminfo: memFree=21322972/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=319776 CPUtime=45.1 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 107386 1257 0 0 4490 20 0 0 18 0 9 0 655581123 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 79944 46449 180 55 0 77830 0
[pid=24238/tid=24245] ppid=24236 vsize=319776 CPUtime=5.68 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 12777 1257 0 0 567 1 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236380 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=319776 CPUtime=5.68 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 9736 1257 0 0 567 1 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4337357 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=319776 CPUtime=5.57 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 13823 1257 0 0 556 1 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=319776 CPUtime=4.83 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 1258 1257 0 0 476 7 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4265399 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=319776 CPUtime=5.67 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 9069 1257 0 0 567 0 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=319776 CPUtime=5.65 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 7963 1257 0 0 564 1 0 0 25 0 9 0 655581184 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4336688 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=319776 CPUtime=5.66 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 6260 1257 0 0 566 0 0 0 25 0 9 0 655581185 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=319776 CPUtime=5.67 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 10426 1257 0 0 566 1 0 0 25 0 9 0 655581185 327450624 46449 33554432000 4194304 4417452 140734288465968 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 45.1
Current children cumulated vsize (KiB) 319776

[startup+12.7012 s]
/proc/loadavg: 7.94 7.74 7.51 9/357 24253
/proc/meminfo: memFree=21324328/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=318972 CPUtime=96.19 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 107550 1257 0 0 9599 20 0 0 18 0 9 0 655581123 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 79743 46248 180 55 0 77629 0
[pid=24238/tid=24245] ppid=24236 vsize=318972 CPUtime=12.08 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 12798 1257 0 0 1207 1 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=318972 CPUtime=12.07 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 9757 1257 0 0 1206 1 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4232791 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=318972 CPUtime=11.89 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 13853 1257 0 0 1188 1 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=318972 CPUtime=11.23 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 1258 1257 0 0 1116 7 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=318972 CPUtime=12.07 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 9089 1257 0 0 1207 0 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=318972 CPUtime=12.05 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 7983 1257 0 0 1204 1 0 0 25 0 9 0 655581184 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=318972 CPUtime=12.05 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 6291 1257 0 0 1205 0 0 0 25 0 9 0 655581185 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4264885 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=318972 CPUtime=12.07 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 10447 1257 0 0 1206 1 0 0 25 0 9 0 655581185 326627328 46248 33554432000 4194304 4417452 140734288465968 18446744073709551615 4232804 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 96.19
Current children cumulated vsize (KiB) 318972

[startup+25.501 s]
/proc/loadavg: 7.96 7.75 7.52 9/357 24253
/proc/meminfo: memFree=21292236/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=358536 CPUtime=198.41 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 117633 1257 0 0 19820 21 0 0 18 0 9 0 655581123 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 89634 56151 180 55 0 87520 0
[pid=24238/tid=24245] ppid=24236 vsize=358536 CPUtime=24.87 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 12837 1257 0 0 2486 1 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=358536 CPUtime=24.87 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 10180 1257 0 0 2486 1 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=358536 CPUtime=24.54 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 14879 1257 0 0 2453 1 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=358536 CPUtime=24.02 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 6602 1257 0 0 2394 8 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=358536 CPUtime=24.86 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 9629 1257 0 0 2486 0 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=358536 CPUtime=24.85 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 8695 1257 0 0 2484 1 0 0 25 0 9 0 655581184 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4357256 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=358536 CPUtime=24.85 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 7133 1257 0 0 2485 0 0 0 25 0 9 0 655581185 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=358536 CPUtime=24.86 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 11604 1257 0 0 2485 1 0 0 25 0 9 0 655581185 367140864 56151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 198.41
Current children cumulated vsize (KiB) 358536

[startup+51.1007 s]
/proc/loadavg: 8.03 7.79 7.54 9/357 24253
/proc/meminfo: memFree=21255700/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=406492 CPUtime=402.85 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 133925 1257 0 0 40256 29 0 0 18 0 9 0 655581123 416247808 68140 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 101623 68140 180 55 0 99509 0
[pid=24238/tid=24245] ppid=24236 vsize=406492 CPUtime=50.47 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 13274 1257 0 0 5046 1 0 0 25 0 9 0 655581184 416247808 68140 33554432000 4194304 4417452 140734288465968 18446744073709551615 4232470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=406492 CPUtime=50.46 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 12947 1257 0 0 5045 1 0 0 25 0 9 0 655581184 416247808 68140 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=406492 CPUtime=49.85 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.03 8.04 8.00 9/357 24390
/proc/meminfo: memFree=18595372/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=3044932 CPUtime=37711.2 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 3695112 1257 0 0 3770457 663 0 0 18 0 9 0 655581123 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 761233 727751 180 55 0 759119 0
[pid=24238/tid=24245] ppid=24236 vsize=3044932 CPUtime=4721.46 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 497878 1257 0 0 472070 76 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4357024 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=3044932 CPUtime=4721.04 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 412149 1257 0 0 472044 60 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=3044932 CPUtime=4718.21 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 468215 1257 0 0 471740 81 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=3044932 CPUtime=4718.01 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 652052 1257 0 0 471602 199 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=3044932 CPUtime=4721.57 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 427713 1257 0 0 472094 63 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=3044932 CPUtime=4720.68 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 342645 1257 0 0 472013 55 0 0 25 0 9 0 655581184 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4365962 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=3044932 CPUtime=4721.07 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 410723 1257 0 0 472050 57 0 0 25 0 9 0 655581185 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=3044932 CPUtime=4668.5 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 447663 1257 0 0 466785 65 0 0 25 0 9 0 655581185 3118010368 727751 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37711.2
Current children cumulated vsize (KiB) 3044932

[startup+4782.3 s]
/proc/loadavg: 8.04 8.05 8.00 9/357 24392
/proc/meminfo: memFree=18654896/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=2986532 CPUtime=38190.4 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 3861994 1257 0 0 3818339 696 0 0 18 0 9 0 655581123 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 746633 713151 180 55 0 744519 0
[pid=24238/tid=24245] ppid=24236 vsize=2986532 CPUtime=4781.44 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 509591 1257 0 0 478065 79 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4262413 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=2986532 CPUtime=4781 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 442610 1257 0 0 478037 63 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=2986532 CPUtime=4778.2 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 512375 1257 0 0 477725 95 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=2986532 CPUtime=4777.97 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 660167 1257 0 0 477596 201 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=2986532 CPUtime=4781.55 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 444098 1257 0 0 478091 64 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=2986532 CPUtime=4780.65 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 342645 1257 0 0 478010 55 0 0 25 0 9 0 655581184 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=2986532 CPUtime=4781.05 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 459859 1257 0 0 478042 63 0 0 25 0 9 0 655581185 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=2986532 CPUtime=4727.8 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 454575 1257 0 0 472712 68 0 0 25 0 9 0 655581185 3058208768 713151 33554432000 4194304 4417452 140734288465968 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38190.4
Current children cumulated vsize (KiB) 2986532

[startup+4842.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/357 24393
/proc/meminfo: memFree=18359636/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=3280900 CPUtime=38669.6 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 3975467 1257 0 0 3866244 714 0 0 18 0 9 0 655581123 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 820225 786743 180 55 0 818111 0
[pid=24238/tid=24245] ppid=24236 vsize=3280900 CPUtime=4841.44 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 542360 1257 0 0 484062 82 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=3280900 CPUtime=4841 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 464555 1257 0 0 484034 66 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=3280900 CPUtime=4838.2 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 542583 1257 0 0 483716 104 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=3280900 CPUtime=4837.94 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 666212 1257 0 0 483592 202 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=3280900 CPUtime=4841.55 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 444098 1257 0 0 484091 64 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=3280900 CPUtime=4840.65 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 345423 1257 0 0 484009 56 0 0 25 0 9 0 655581184 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=3280900 CPUtime=4841.04 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 471395 1257 0 0 484040 64 0 0 25 0 9 0 655581185 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=3280900 CPUtime=4787.08 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 462767 1257 0 0 478640 68 0 0 25 0 9 0 655581185 3359641600 786743 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38669.6
Current children cumulated vsize (KiB) 3280900

[startup+4902.3 s]
/proc/loadavg: 8.08 8.04 8.00 9/357 24395
/proc/meminfo: memFree=18024948/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=3615048 CPUtime=39148.8 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 4075388 1257 0 0 3914147 734 0 0 18 0 9 0 655581123 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 903762 870280 180 55 0 901648 0
[pid=24238/tid=24245] ppid=24236 vsize=3615048 CPUtime=4901.44 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 542360 1257 0 0 490062 82 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=3615048 CPUtime=4901 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 480033 1257 0 0 490032 68 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=3615048 CPUtime=4898.19 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 542583 1257 0 0 489715 104 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=3615048 CPUtime=4897.91 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 672452 1257 0 0 489586 205 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=3615048 CPUtime=4901.55 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 472258 1257 0 0 490082 73 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=3615048 CPUtime=4900.63 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 360320 1257 0 0 490006 57 0 0 25 0 9 0 655581184 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=3615048 CPUtime=4901.04 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 490324 1257 0 0 490037 67 0 0 25 0 9 0 655581185 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=3615048 CPUtime=4846.38 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 478984 1257 0 0 484566 72 0 0 25 0 9 0 655581185 3701809152 870280 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39148.8
Current children cumulated vsize (KiB) 3615048

[startup+4962.3 s]
/proc/loadavg: 8.09 8.05 8.00 9/357 24397
/proc/meminfo: memFree=18497144/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=3143708 CPUtime=39628 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 4244957 1257 0 0 3962032 771 0 0 18 0 9 0 655581123 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 785927 752414 180 55 0 783813 0
[pid=24238/tid=24245] ppid=24236 vsize=3143708 CPUtime=4961.44 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 558745 1257 0 0 496061 83 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=3143708 CPUtime=4961 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 503456 1257 0 0 496024 76 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=3143708 CPUtime=4958.18 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 581116 1257 0 0 495706 112 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=3143708 CPUtime=4957.87 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 675087 1257 0 0 495581 206 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=3143708 CPUtime=4961.55 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 490322 1257 0 0 496077 78 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=3143708 CPUtime=4960.61 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 393926 1257 0 0 495998 63 0 0 25 0 9 0 655581184 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=3143708 CPUtime=4961.02 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 527247 1257 0 0 496029 73 0 0 25 0 9 0 655581185 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=3143708 CPUtime=4905.66 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 478984 1257 0 0 490494 72 0 0 25 0 9 0 655581185 3219156992 752414 33554432000 4194304 4417452 140734288465968 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39628
Current children cumulated vsize (KiB) 3143708



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5008.9 s]
/proc/loadavg: 8.11 8.06 8.00 9/357 24398
/proc/meminfo: memFree=18626848/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=3014388 CPUtime=40000.3 cores=0-7
/proc/24238/stat : 24238 (plingeling) S 24236 24238 23933 0 -1 4202496 4328685 1257 0 0 3999241 790 0 0 18 0 9 0 655581123 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 753597 720084 180 55 0 751483 0
[pid=24238/tid=24245] ppid=24236 vsize=3014388 CPUtime=5008.05 cores=0-7
/proc/24238/task/24245/stat : 24245 (plingeling) R 24236 24238 23933 0 -1 4202560 558745 1257 0 0 500722 83 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4263206 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24238/tid=24246] ppid=24236 vsize=3014388 CPUtime=5007.61 cores=0-7
/proc/24238/task/24246/stat : 24246 (plingeling) R 24236 24238 23933 0 -1 4202560 512815 1257 0 0 500682 79 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24238/tid=24247] ppid=24236 vsize=3014388 CPUtime=5004.79 cores=0-7
/proc/24238/task/24247/stat : 24247 (plingeling) R 24236 24238 23933 0 -1 4202560 603464 1257 0 0 500363 116 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24238/tid=24248] ppid=24236 vsize=3014388 CPUtime=5004.46 cores=0-7
/proc/24238/task/24248/stat : 24248 (plingeling) R 24236 24238 23933 0 -1 4202560 677723 1257 0 0 500239 207 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24238/tid=24249] ppid=24236 vsize=3014388 CPUtime=5008.16 cores=0-7
/proc/24238/task/24249/stat : 24249 (plingeling) R 24236 24238 23933 0 -1 4202560 495437 1257 0 0 500736 80 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4357241 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24238/tid=24250] ppid=24236 vsize=3014388 CPUtime=5007.21 cores=0-7
/proc/24238/task/24250/stat : 24250 (plingeling) R 24236 24238 23933 0 -1 4202560 407302 1257 0 0 500656 65 0 0 25 0 9 0 655581184 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24238/tid=24251] ppid=24236 vsize=3014388 CPUtime=5007.63 cores=0-7
/proc/24238/task/24251/stat : 24251 (plingeling) R 24236 24238 23933 0 -1 4202560 540731 1257 0 0 500686 77 0 0 25 0 9 0 655581185 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=3014388 CPUtime=4951.72 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4202560 496394 1257 0 0 495098 74 0 0 25 0 9 0 655581185 3086733312 720084 33554432000 4194304 4417452 140734288465968 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 3014388

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.02 s]
/proc/loadavg: 8.11 8.06 8.00 9/357 24398
/proc/meminfo: memFree=18626848/32951132 swapFree=64495980/67111528
[pid=24238] ppid=24236 vsize=0 CPUtime=40000.5 cores=0-7
/proc/24238/stat : 24238 (plingeling) Z 24236 24238 23933 0 -1 4203548 4328685 1257 0 0 3999247 800 0 0 18 0 2 0 655581123 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/24238/statm: 0 0 0 0 0 0 0
[pid=24238/tid=24252] ppid=24236 vsize=0 CPUtime=4951.82 cores=0-7
/proc/24238/task/24252/stat : 24252 (plingeling) R 24236 24238 23933 0 -1 4203588 496394 1257 0 0 495098 84 0 0 25 0 2 0 655581185 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.03
CPU time (s): 40000.5
CPU user time (s): 39992.5
CPU system time (s): 8.01078
CPU usage (%): 798.568
Max. virtual memory (cumulated for all children) (KiB): 3615048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39992.5
system time used= 8.01078
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4329942
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 736
involuntary context switches= 144335

runsolver used 17.0454 second user time and 41.9056 second system time

The end

Launcher Data 

Begin job on node129 at 2011-05-15 08:10:15
IDJOB=3372665
IDBENCH=83107
IDSOLVER=1851
FILE ID=node129/3372665-1305439815
RUNJOBID= node129-1305437281-23947
PBS_JOBID= 13324767
Free space on /tmp= 73408 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom26.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372665-1305439815/watcher-3372665-1305439815 -o /tmp/evaluation-result-3372665-1305439815/solver-3372665-1305439815 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372665-1305439815.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 98fee1752ddf8cd7cd77925ecf4bfe6e
RANDOM SEED=1697801949

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      21511156 kB
Buffers:        254052 kB
Cached:        6012292 kB
SwapCached:      52668 kB
Active:        2956176 kB
Inactive:      8258448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      21511156 kB
SwapTotal:    67111528 kB
SwapFree:     64495980 kB
Dirty:            4696 kB
Writeback:          20 kB
AnonPages:     4904524 kB
Mapped:          16812 kB
Slab:           121092 kB
PageTables:      37532 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 79734084 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73408 MiB
End job on node129 at 2011-05-15 09:33:46