Trace number 3309840

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.6 5004.41

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom22.cnf
MD5SUM808b4b06b3dea960876e6772f0b9c207
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables53118
Number of clauses178062
Sum of the clauses size454634
Maximum clause length1670
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 290658
Number of clauses of size 386491
Number of clauses of size 4252
Number of clauses of size 520
Number of clauses of size over 5640

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309840-1304011046/watcher-3309840-1304011046 -o /tmp/evaluation-result-3309840-1304011046/solver-3309840-1304011046 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309840-1304011046.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.86 7.80 7.92 2/168 4883
/proc/meminfo: memFree=26745724/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=15520 CPUtime=0 cores=0-7
/proc/4883/stat : 4883 (plingeling) R 4881 4883 4857 0 -1 4202496 1933 1252 0 0 0 0 0 0 25 0 1 0 512703241 15892480 1861 33554432000 4194304 4417332 140734605678112 18446744073709551615 242970244189 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4883/statm: 3880 1875 140 55 0 1766 0

[startup+0.0617401 s]
/proc/loadavg: 6.86 7.80 7.92 2/168 4883
/proc/meminfo: memFree=26745724/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=29788 CPUtime=0.05 cores=0-7
/proc/4883/stat : 4883 (plingeling) R 4881 4883 4857 0 -1 4202496 5582 1252 0 0 5 0 0 0 25 0 1 0 512703241 30502912 5454 33554432000 4194304 4417332 140734605678112 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4883/statm: 7447 5454 148 55 0 5333 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 29788

[startup+0.100739 s]
/proc/loadavg: 6.86 7.80 7.92 2/168 4883
/proc/meminfo: memFree=26745724/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=40172 CPUtime=0.08 cores=0-7
/proc/4883/stat : 4883 (plingeling) R 4881 4883 4857 0 -1 4202496 8146 1252 0 0 8 0 0 0 25 0 1 0 512703241 41136128 8019 33554432000 4194304 4417332 140734605678112 18446744073709551615 242970244077 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4883/statm: 10043 8050 148 55 0 7929 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 40172

[startup+0.300706 s]
/proc/loadavg: 6.86 7.80 7.92 2/168 4883
/proc/meminfo: memFree=26745724/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=81112 CPUtime=0.28 cores=0-7
/proc/4883/stat : 4883 (plingeling) R 4881 4883 4857 0 -1 4202496 18429 1252 0 0 27 1 0 0 25 0 1 0 512703241 83058688 18301 33554432000 4194304 4417332 140734605678112 18446744073709551615 4231256 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4883/statm: 20278 18301 148 55 0 18164 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 81112

[startup+0.700604 s]
/proc/loadavg: 6.86 7.80 7.92 2/168 4883
/proc/meminfo: memFree=26745724/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=228444 CPUtime=2.5 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 33162 1252 0 0 247 3 0 0 18 0 9 0 512703241 233926656 23167 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 57111 23167 175 55 0 54997 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 228444

[startup+1.50046 s]
/proc/loadavg: 6.86 7.80 7.92 9/177 4898
/proc/meminfo: memFree=26654636/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=233248 CPUtime=8.9 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 42661 1252 0 0 885 5 0 0 18 0 9 0 512703241 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 58312 22516 175 55 0 56198 0
[pid=4883/tid=4890] ppid=4881 vsize=233248 CPUtime=1.07 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 2634 1252 0 0 107 0 0 0 19 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=233248 CPUtime=1.07 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 1721 1252 0 0 107 0 0 0 19 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4234240 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=233248 CPUtime=1.06 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 4001 1252 0 0 106 0 0 0 19 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4286467 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=233248 CPUtime=1.07 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 1301 1252 0 0 107 0 0 0 19 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=233248 CPUtime=1.06 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 4087 1252 0 0 106 0 0 0 21 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4302510 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=233248 CPUtime=1.07 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 2110 1252 0 0 107 0 0 0 19 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=233248 CPUtime=0.98 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 2743 1252 0 0 98 0 0 0 21 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4290403 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=233248 CPUtime=1.05 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 5619 1252 0 0 105 0 0 0 21 0 9 0 512703284 238845952 22516 33554432000 4194304 4417332 140734605678112 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 8.9
Current children cumulated vsize (KiB) 233248

[startup+3.10119 s]
/proc/loadavg: 6.86 7.80 7.92 9/177 4898
/proc/meminfo: memFree=26641244/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=274624 CPUtime=21.64 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 70550 1252 0 0 2155 9 0 0 18 0 9 0 512703241 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 68656 32687 181 55 0 66542 0
[pid=4883/tid=4890] ppid=4881 vsize=274624 CPUtime=2.67 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 4633 1252 0 0 267 0 0 0 23 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=274624 CPUtime=2.67 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 5817 1252 0 0 267 0 0 0 23 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4330435 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=274624 CPUtime=2.66 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 6992 1252 0 0 265 1 0 0 23 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4236324 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=274624 CPUtime=2.67 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 2325 1252 0 0 267 0 0 0 22 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=274624 CPUtime=2.67 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 8713 1252 0 0 266 1 0 0 25 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=274624 CPUtime=2.66 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 5941 1252 0 0 266 0 0 0 22 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=274624 CPUtime=2.58 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 9551 1252 0 0 257 1 0 0 25 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4330467 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=274624 CPUtime=2.6 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 8133 1252 0 0 258 2 0 0 25 0 9 0 512703284 281214976 32687 33554432000 4194304 4417332 140734605678112 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 21.64
Current children cumulated vsize (KiB) 274624

[startup+6.30064 s]
/proc/loadavg: 6.95 7.80 7.92 9/177 4898
/proc/meminfo: memFree=26618932/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=251768 CPUtime=46.36 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 75200 1252 0 0 4613 23 0 0 18 0 9 0 512703241 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 62942 29564 181 55 0 60828 0
[pid=4883/tid=4890] ppid=4881 vsize=251768 CPUtime=5.85 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 4994 1252 0 0 584 1 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365991 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=251768 CPUtime=5.76 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 6179 1252 0 0 575 1 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=251768 CPUtime=5.84 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 7013 1252 0 0 583 1 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364397 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=251768 CPUtime=5.87 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 2325 1252 0 0 587 0 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=251768 CPUtime=5.86 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 10265 1252 0 0 584 2 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4245635 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=251768 CPUtime=5.86 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 6303 1252 0 0 585 1 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=251768 CPUtime=5.31 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 10921 1252 0 0 529 2 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=251768 CPUtime=5.52 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 8755 1252 0 0 542 10 0 0 25 0 9 0 512703284 257810432 29564 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 46.36
Current children cumulated vsize (KiB) 251768

[startup+12.7005 s]
/proc/loadavg: 7.04 7.81 7.92 9/177 4898
/proc/meminfo: memFree=26613996/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=265620 CPUtime=97.51 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 78827 1252 0 0 9727 24 0 0 18 0 9 0 512703241 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 66405 33044 181 55 0 64291 0
[pid=4883/tid=4890] ppid=4881 vsize=265620 CPUtime=12.25 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 5020 1252 0 0 1224 1 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=265620 CPUtime=12.16 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 6340 1252 0 0 1215 1 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=265620 CPUtime=12.2 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 7131 1252 0 0 1219 1 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=265620 CPUtime=12.26 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 3420 1252 0 0 1226 0 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=265620 CPUtime=12.25 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 10636 1252 0 0 1223 2 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=265620 CPUtime=12.26 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 6339 1252 0 0 1225 1 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4270858 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=265620 CPUtime=11.71 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 12613 1252 0 0 1169 2 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=265620 CPUtime=11.92 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 8883 1252 0 0 1182 10 0 0 25 0 9 0 512703284 271994880 33044 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365856 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 97.51
Current children cumulated vsize (KiB) 265620

[startup+25.5013 s]
/proc/loadavg: 7.25 7.82 7.92 9/177 4898
/proc/meminfo: memFree=26572704/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=308372 CPUtime=199.84 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 96681 1252 0 0 19958 26 0 0 18 0 9 0 512703241 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 77093 43727 181 55 0 74979 0
[pid=4883/tid=4890] ppid=4881 vsize=308372 CPUtime=25.05 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 6613 1252 0 0 2504 1 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=308372 CPUtime=24.96 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 8661 1252 0 0 2495 1 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=308372 CPUtime=24.94 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 9021 1252 0 0 2493 1 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=308372 CPUtime=25.07 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 8079 1252 0 0 2506 1 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=308372 CPUtime=25.05 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 12257 1252 0 0 2503 2 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4265368 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=308372 CPUtime=25.06 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 7376 1252 0 0 2505 1 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=308372 CPUtime=24.51 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 16322 1252 0 0 2448 3 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=308372 CPUtime=24.72 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 9907 1252 0 0 2462 10 0 0 25 0 9 0 512703284 315772928 43727 33554432000 4194304 4417332 140734605678112 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 199.84
Current children cumulated vsize (KiB) 308372

[startup+51.1009 s]
/proc/loadavg: 7.58 7.85 7.93 9/177 4899
/proc/meminfo: memFree=26519608/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=362180 CPUtime=404.46 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 123619 1252 0 0 40413 33 0 0 18 0 9 0 512703241 370872320 57179 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 90545 57179 181 55 0 88431 0
[pid=4883/tid=4890] ppid=4881 vsize=362180 CPUtime=50.65 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 9289 1252 0 0 5063 2 0 0 25 0 9 0 512703284 370872320 57179 33554432000 4194304 4417332 140734605678112 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=362180 CPUtime=50.56 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 11768 1252 0 0 5054 2 0 0 25 0 9 0 512703284 370872320 57179 33554432000 4194304 4417332 140734605678112 18446744073709551615 4252408 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=362180 CPUtime=50.42 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.07 8.04 8.00 9/177 5035
/proc/meminfo: memFree=23590236/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=3272108 CPUtime=37746.7 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5180849 1252 0 0 3773667 1004 0 0 18 0 9 0 512703241 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 818027 787887 181 55 0 815913 0
[pid=4883/tid=4890] ppid=4881 vsize=3272108 CPUtime=4720.12 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 631866 1252 0 0 471904 108 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365906 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=3272108 CPUtime=4720.81 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 563138 1252 0 0 471978 103 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=3272108 CPUtime=4699.09 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 589487 1252 0 0 469806 103 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=3272108 CPUtime=4721.8 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 660756 1252 0 0 472078 102 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=3272108 CPUtime=4721.33 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 631708 1252 0 0 472015 118 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4354148 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=3272108 CPUtime=4721.79 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 829487 1252 0 0 472057 122 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=3272108 CPUtime=4721.25 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 573885 1252 0 0 472037 88 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=3272108 CPUtime=4720.03 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 682077 1252 0 0 471748 255 0 0 25 0 9 0 512703284 3350638592 787887 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37746.7
Current children cumulated vsize (KiB) 3272108

[startup+4782.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/177 5037
/proc/meminfo: memFree=23156856/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=3721660 CPUtime=38226.3 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5349082 1252 0 0 3821594 1039 0 0 18 0 9 0 512703241 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 930415 900275 181 55 0 928301 0
[pid=4883/tid=4890] ppid=4881 vsize=3721660 CPUtime=4780.1 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 652787 1252 0 0 477899 111 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4366558 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=3721660 CPUtime=4780.8 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 591714 1252 0 0 477971 109 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=3721660 CPUtime=4758.8 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 648723 1252 0 0 475762 118 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=3721660 CPUtime=4781.79 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 684876 1252 0 0 478072 107 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=3721660 CPUtime=4781.32 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 646601 1252 0 0 478012 120 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=3721660 CPUtime=4781.78 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 829487 1252 0 0 478056 122 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=3721660 CPUtime=4781.24 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 573885 1252 0 0 478036 88 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=3721660 CPUtime=4780.01 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 702564 1252 0 0 477742 259 0 0 25 0 9 0 512703284 3810979840 900275 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38226.3
Current children cumulated vsize (KiB) 3721660

[startup+4842.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/177 5039
/proc/meminfo: memFree=22770472/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=4090900 CPUtime=38706 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5475233 1252 0 0 3869536 1066 0 0 18 0 9 0 512703241 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 1022725 992585 181 55 0 1020611 0
[pid=4883/tid=4890] ppid=4881 vsize=4090900 CPUtime=4840.08 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 678351 1252 0 0 483893 115 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=4090900 CPUtime=4840.8 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 591714 1252 0 0 483971 109 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4250986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=4090900 CPUtime=4818.51 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 665107 1252 0 0 481728 123 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=4090900 CPUtime=4841.8 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 688172 1252 0 0 484072 108 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=4090900 CPUtime=4841.32 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 656057 1252 0 0 484011 121 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=4090900 CPUtime=4841.79 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 829500 1252 0 0 484057 122 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=4090900 CPUtime=4841.24 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 645323 1252 0 0 484022 102 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=4090900 CPUtime=4839.99 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 702564 1252 0 0 483739 260 0 0 25 0 9 0 512703284 4189081600 992585 33554432000 4194304 4417332 140734605678112 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38706
Current children cumulated vsize (KiB) 4090900

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/177 5040
/proc/meminfo: memFree=23004828/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=3843028 CPUtime=39185.7 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5583098 1252 0 0 3917487 1084 0 0 18 0 9 0 512703241 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 960757 934012 181 55 0 958643 0
[pid=4883/tid=4890] ppid=4881 vsize=3843028 CPUtime=4900.07 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 689539 1252 0 0 489889 118 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=3843028 CPUtime=4900.8 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 591714 1252 0 0 489971 109 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=3843028 CPUtime=4878.23 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 722372 1252 0 0 487693 130 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=3843028 CPUtime=4901.79 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 691468 1252 0 0 490071 108 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=3843028 CPUtime=4901.32 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 672745 1252 0 0 490007 125 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=3843028 CPUtime=4901.79 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 848928 1252 0 0 490053 126 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=3843028 CPUtime=4901.25 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 645323 1252 0 0 490023 102 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=3843028 CPUtime=4899.97 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 702564 1252 0 0 489736 261 0 0 25 0 9 0 512703284 3935260672 934012 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39185.7
Current children cumulated vsize (KiB) 3843028

[startup+4962.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/177 5042
/proc/meminfo: memFree=22842248/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=4005156 CPUtime=39665.4 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5693795 1252 0 0 3965429 1108 0 0 18 0 9 0 512703241 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 1001289 974544 181 55 0 999175 0
[pid=4883/tid=4890] ppid=4881 vsize=4005156 CPUtime=4960.04 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 700555 1252 0 0 495884 120 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=4005156 CPUtime=4960.81 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 608098 1252 0 0 495970 111 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4308374 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=4005156 CPUtime=4937.93 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 738756 1252 0 0 493661 132 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=4005156 CPUtime=4961.79 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 693756 1252 0 0 496071 108 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=4005156 CPUtime=4961.33 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 715699 1252 0 0 495998 135 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=4005156 CPUtime=4961.79 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 870599 1252 0 0 496046 133 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=4005156 CPUtime=4961.25 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 645323 1252 0 0 496023 102 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=4005156 CPUtime=4959.95 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 702564 1252 0 0 495733 262 0 0 25 0 9 0 512703284 4101279744 974544 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39665.4
Current children cumulated vsize (KiB) 4005156



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.2 s]
/proc/loadavg: 8.03 8.04 8.00 9/177 5043
/proc/meminfo: memFree=22691588/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=4155672 CPUtime=40000.4 cores=0-7
/proc/4883/stat : 4883 (plingeling) S 4881 4883 4857 0 -1 4202496 5833066 1252 0 0 3998899 1139 0 0 18 0 9 0 512703241 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 1038918 1012172 181 55 0 1036804 0
[pid=4883/tid=4890] ppid=4881 vsize=4155672 CPUtime=5001.93 cores=0-7
/proc/4883/task/4890/stat : 4890 (plingeling) R 4881 4883 4857 0 -1 4202560 704698 1252 0 0 500072 121 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4346414 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4883/tid=4891] ppid=4881 vsize=4155672 CPUtime=5002.7 cores=0-7
/proc/4883/task/4891/stat : 4891 (plingeling) R 4881 4883 4857 0 -1 4202560 647768 1252 0 0 500153 117 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=4155672 CPUtime=4979.64 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4202560 738756 1252 0 0 497832 132 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4883/tid=4893] ppid=4881 vsize=4155672 CPUtime=5003.71 cores=0-7
/proc/4883/task/4893/stat : 4893 (plingeling) R 4881 4883 4857 0 -1 4202560 696044 1252 0 0 500262 109 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4883/tid=4894] ppid=4881 vsize=4155672 CPUtime=5003.23 cores=0-7
/proc/4883/task/4894/stat : 4894 (plingeling) R 4881 4883 4857 0 -1 4202560 715699 1252 0 0 500188 135 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4883/tid=4895] ppid=4881 vsize=4155672 CPUtime=5003.7 cores=0-7
/proc/4883/task/4895/stat : 4895 (plingeling) R 4881 4883 4857 0 -1 4202560 870599 1252 0 0 500237 133 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4883/tid=4896] ppid=4881 vsize=4155672 CPUtime=5003.15 cores=0-7
/proc/4883/task/4896/stat : 4896 (plingeling) R 4881 4883 4857 0 -1 4202560 707056 1252 0 0 500197 118 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4883/tid=4897] ppid=4881 vsize=4155672 CPUtime=5001.84 cores=0-7
/proc/4883/task/4897/stat : 4897 (plingeling) R 4881 4883 4857 0 -1 4202560 734001 1252 0 0 499916 268 0 0 25 0 9 0 512703284 4255408128 1012172 33554432000 4194304 4417332 140734605678112 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4155672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5004.4 s]
/proc/loadavg: 8.03 8.04 8.00 9/177 5043
/proc/meminfo: memFree=22691588/32951132 swapFree=67111364/67111528
[pid=4883] ppid=4881 vsize=0 CPUtime=40000.6 cores=0-7
/proc/4883/stat : 4883 (plingeling) Z 4881 4883 4857 0 -1 4203548 5833066 1252 0 0 3998904 1158 0 0 18 0 2 0 512703241 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4883/statm: 0 0 0 0 0 0 0
[pid=4883/tid=4892] ppid=4881 vsize=0 CPUtime=4979.83 cores=0-7
/proc/4883/task/4892/stat : 4892 (plingeling) R 4881 4883 4857 0 -1 4203588 738756 1252 0 0 497832 151 0 0 25 0 2 0 512703284 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.41
CPU time (s): 40000.6
CPU user time (s): 39989
CPU system time (s): 11.5872
CPU usage (%): 799.308
Max. virtual memory (cumulated for all children) (KiB): 4204124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989
system time used= 11.5872
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5834318
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 643
involuntary context switches= 187830

runsolver used 6.92395 second user time and 16.6815 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-28 19:17:26
IDJOB=3309840
IDBENCH=83133
IDSOLVER=1695
FILE ID=node128/3309840-1304011046
RUNJOBID= node128-1304011046-4871
PBS_JOBID= 13168854
Free space on /tmp= 66972 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom22.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309840-1304011046/watcher-3309840-1304011046 -o /tmp/evaluation-result-3309840-1304011046/solver-3309840-1304011046 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309840-1304011046.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 808b4b06b3dea960876e6772f0b9c207
RANDOM SEED=1114753386

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      26745748 kB
Buffers:       1254836 kB
Cached:        4297884 kB
SwapCached:        160 kB
Active:          85076 kB
Inactive:      5531736 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      26745748 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            3632 kB
Writeback:           4 kB
AnonPages:       63580 kB
Mapped:          14504 kB
Slab:           523156 kB
PageTables:       4424 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   185824 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66972 MiB
End job on node128 at 2011-04-28 20:40:52