Trace number 3281571

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.24 1204.67

General information on the benchmark

Namevelev-vliw-uns-4.0-9-i1.cnf
MD5SUM590cca3a58efdeb1c95ef988a53daa1d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark420.299
Satisfiable
(Un)Satisfiability was proved
Number of variables154309
Number of clauses3230738
Sum of the clauses size9429252
Maximum clause length3625
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 22024994
Number of clauses of size 31081436
Number of clauses of size 48866
Number of clauses of size 58692
Number of clauses of size over 5106749

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281571-1304039809/watcher-3281571-1304039809 -o /tmp/evaluation-result-3281571-1304039809/solver-3281571-1304039809 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3281571-1304039809.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.23 7.22 7.67 5/181 28705
/proc/meminfo: memFree=20155360/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=10952 CPUtime=0 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 825 1254 0 0 0 0 0 0 23 0 1 0 594211748 11214848 753 33554432000 4194304 4417332 140736369882416 18446744073709551615 231895151301 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 2738 760 147 55 0 624 0

[startup+0.024795 s]
/proc/loadavg: 6.23 7.22 7.67 5/181 28705
/proc/meminfo: memFree=20155360/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=14544 CPUtime=0.01 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 1731 1254 0 0 1 0 0 0 23 0 1 0 594211748 14893056 1659 33554432000 4194304 4417332 140736369882416 18446744073709551615 4259708 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 3636 1659 148 55 0 1522 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 14544

[startup+0.10078 s]
/proc/loadavg: 6.23 7.22 7.67 5/181 28705
/proc/meminfo: memFree=20155360/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=25780 CPUtime=0.09 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 4556 1254 0 0 9 0 0 0 23 0 1 0 594211748 26398720 4468 33554432000 4194304 4417332 140736369882416 18446744073709551615 4320825 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 6445 4468 148 55 0 4331 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25780

[startup+0.300743 s]
/proc/loadavg: 6.23 7.22 7.67 5/181 28705
/proc/meminfo: memFree=20155360/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=54320 CPUtime=0.29 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 11732 1254 0 0 28 1 0 0 24 0 1 0 594211748 55623680 11603 33554432000 4194304 4417332 140736369882416 18446744073709551615 4261968 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 13580 11603 148 55 0 11466 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 54320

[startup+0.700673 s]
/proc/loadavg: 6.23 7.22 7.67 5/181 28705
/proc/meminfo: memFree=20155360/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=78896 CPUtime=0.69 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 17876 1254 0 0 67 2 0 0 25 0 1 0 594211748 80789504 17747 33554432000 4194304 4417332 140736369882416 18446744073709551615 231895109245 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 19724 17747 148 55 0 17610 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 78896

[startup+1.50051 s]
/proc/loadavg: 6.23 7.22 7.67 7/182 28711
/proc/meminfo: memFree=20032476/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=212276 CPUtime=1.49 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 51221 1254 0 0 143 6 0 0 25 0 1 0 594211748 217370624 51092 33554432000 4194304 4417332 140736369882416 18446744073709551615 4320656 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 53069 51092 148 55 0 50955 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 212276

[startup+3.10022 s]
/proc/loadavg: 6.23 7.22 7.67 7/182 28711
/proc/meminfo: memFree=19910336/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=413484 CPUtime=3.09 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) R 28703 28705 28251 0 -1 4202496 101527 1254 0 0 296 13 0 0 25 0 1 0 594211748 423407616 101394 33554432000 4194304 4417332 140736369882416 18446744073709551615 4320936 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/28705/statm: 103371 101394 148 55 0 101257 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 413484

[startup+6.30055 s]
/proc/loadavg: 6.21 7.20 7.66 9/186 28715
/proc/meminfo: memFree=19786884/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=498680 CPUtime=13.49 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 123233 1254 0 0 1331 18 0 0 18 0 5 0 594211748 510648320 96703 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 124670 96703 174 55 0 122556 0
[pid=28705/tid=28712] ppid=28703 vsize=498680 CPUtime=2.4 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 5139 1254 0 0 239 1 0 0 25 0 5 0 594212138 510648320 96703 33554432000 4194304 4417332 140736369882416 18446744073709551615 4247490 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=498680 CPUtime=2.39 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 7949 1254 0 0 238 1 0 0 25 0 5 0 594212138 510648320 96703 33554432000 4194304 4417332 140736369882416 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=498680 CPUtime=2.39 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 4321 1254 0 0 239 0 0 0 25 0 5 0 594212138 510648320 96703 33554432000 4194304 4417332 140736369882416 18446744073709551615 4234336 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=498680 CPUtime=2.38 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 4285 1254 0 0 238 0 0 0 25 0 5 0 594212138 510648320 96703 33554432000 4194304 4417332 140736369882416 18446744073709551615 4365407 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 13.49
Current children cumulated vsize (KiB) 498680

[startup+12.7003 s]
/proc/loadavg: 6.35 7.21 7.66 9/186 28716
/proc/meminfo: memFree=19578952/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=695524 CPUtime=39.04 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 299159 1254 0 0 3855 49 0 0 18 0 5 0 594211748 712216576 145919 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 173881 145919 179 55 0 171767 0
[pid=28705/tid=28712] ppid=28703 vsize=695524 CPUtime=8.8 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 68063 1254 0 0 869 11 0 0 25 0 5 0 594212138 712216576 145919 33554432000 4194304 4417332 140736369882416 18446744073709551615 4254955 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=695524 CPUtime=8.79 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 71795 1254 0 0 867 12 0 0 25 0 5 0 594212138 712216576 145919 33554432000 4194304 4417332 140736369882416 18446744073709551615 4254456 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=695524 CPUtime=8.79 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 53477 1254 0 0 869 10 0 0 25 0 5 0 594212138 712216576 145919 33554432000 4194304 4417332 140736369882416 18446744073709551615 4255010 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=695524 CPUtime=8.74 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 4285 1254 0 0 874 0 0 0 25 0 5 0 594212138 712216576 145919 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232702 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39.04
Current children cumulated vsize (KiB) 695524

[startup+25.501 s]
/proc/loadavg: 6.72 7.25 7.66 9/186 28716
/proc/meminfo: memFree=19554072/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=707040 CPUtime=90.17 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 302059 1254 0 0 8967 50 0 0 18 0 5 0 594211748 724008960 148812 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 176760 148812 181 55 0 174646 0
[pid=28705/tid=28712] ppid=28703 vsize=707040 CPUtime=21.6 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 68250 1254 0 0 2149 11 0 0 25 0 5 0 594212138 724008960 148812 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=707040 CPUtime=21.59 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 73130 1254 0 0 2147 12 0 0 25 0 5 0 594212138 724008960 148812 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=707040 CPUtime=21.59 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 54574 1254 0 0 2149 10 0 0 25 0 5 0 594212138 724008960 148812 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=707040 CPUtime=21.47 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 4566 1254 0 0 2147 0 0 0 25 0 5 0 594212138 724008960 148812 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 90.17
Current children cumulated vsize (KiB) 707040

[startup+51.1012 s]
/proc/loadavg: 7.15 7.31 7.67 9/186 28717
/proc/meminfo: memFree=19430428/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=783668 CPUtime=192.41 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 421780 1254 0 0 19169 72 0 0 18 0 5 0 594211748 802476032 167969 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 195917 167969 181 55 0 193803 0
[pid=28705/tid=28712] ppid=28703 vsize=783668 CPUtime=47.2 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 103912 1254 0 0 4702 18 0 0 25 0 5 0 594212138 802476032 167969 33554432000 4194304 4417332 140736369882416 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=783668 CPUtime=47.17 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 107625 1254 0 0 4697 20 0 0 25 0 5 0 594212138 802476032 167969 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232685 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=783668 CPUtime=47.19 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 87512 1254 0 0 4702 17 0 0 25 0 5 0 594212138 802476032 167969 33554432000 4194304 4417332 140736369882416 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=783668 CPUtime=46.94 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 21192 1254 0 0 4692 2 0 0 25 0 5 0 594212138 802476032 167969 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 192.41
Current children cumulated vsize (KiB) 783668

[startup+102.307 s]
/proc/loadavg: 7.63 7.41 7.69 9/186 28718
/proc/meminfo: memFree=19372000/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=771948 CPUtime=396.96 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 550954 1254 0 0 39608 88 0 0 18 0 5 0 594211748 790474752 165071 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 192987 165071 181 55 0 190873 0
[pid=28705/tid=28712] ppid=28703 vsize=771948 CPUtime=98.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 137137 1254 0 0 9819 22 0 0 25 0 5 0 594212138 790474752 165071 33554432000 4194304 4417332 140736369882416 18446744073709551615 4270989 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=771948 CPUtime=98.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 155378 1254 0 0 9813 25 0 0 25 0 5 0 594212138 790474752 165071 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=771948 CPUtime=98.39 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 135708 1254 0 0 9816 23 0 0 25 0 5 0 594212138 790474752 165071 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=771948 CPUtime=97.86 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 21192 1254 0 0 9784 2 0 0 25 0 5 0 594212138 790474752 165071 33554432000 4194304 4417332 140736369882416 18446744073709551615 4265433 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 396.96
Current children cumulated vsize (KiB) 771948

[startup+162.3 s]
/proc/loadavg: 7.72 7.47 7.69 9/186 28756
/proc/meminfo: memFree=19672820/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=788044 CPUtime=636.6 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 639899 1254 0 0 63559 101 0 0 18 0 5 0 594211748 806957056 169101 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 197011 169101 181 55 0 194897 0
[pid=28705/tid=28712] ppid=28703 vsize=788044 CPUtime=158.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 158441 1254 0 0 15816 25 0 0 25 0 5 0 594212138 806957056 169101 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=788044 CPUtime=158.37 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 207011 1254 0 0 15804 33 0 0 25 0 5 0 594212138 806957056 169101 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=788044 CPUtime=158.39 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 150070 1254 0 0 15814 25 0 0 25 0 5 0 594212138 806957056 169101 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=788044 CPUtime=157.51 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 22838 1254 0 0 15749 2 0 0 25 0 5 0 594212138 806957056 169101 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 636.6
Current children cumulated vsize (KiB) 788044

[startup+222.301 s]
/proc/loadavg: 7.98 7.59 7.72 9/186 28757
/proc/meminfo: memFree=19557476/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=828568 CPUtime=876.28 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 755545 1254 0 0 87512 116 0 0 18 0 5 0 594211748 848453632 179200 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 207142 179200 181 55 0 205028 0
[pid=28705/tid=28712] ppid=28703 vsize=828568 CPUtime=218.4 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 211479 1254 0 0 21809 31 0 0 25 0 5 0 594212138 848453632 179200 33554432000 4194304 4417332 140736369882416 18446744073709551615 4282356 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=828568 CPUtime=218.37 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 210675 1254 0 0 21804 33 0 0 25 0 5 0 594212138 848453632 179200 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=828568 CPUtime=218.39 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 198853 1254 0 0 21807 32 0 0 25 0 5 0 594212138 848453632 179200 33554432000 4194304 4417332 140736369882416 18446744073709551615 4233467 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=828568 CPUtime=217.19 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 32999 1254 0 0 21715 4 0 0 25 0 5 0 594212138 848453632 179200 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 876.28
Current children cumulated vsize (KiB) 828568

################
# More data... #
################

[pid=28705/tid=28713] ppid=28703 vsize=1023540 CPUtime=698.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 387289 1254 0 0 69781 57 0 0 25 0 5 0 594212138 1048104960 227340 33554432000 4194304 4417332 140736369882416 18446744073709551615 4346278 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1023540 CPUtime=698.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 412983 1254 0 0 69781 59 0 0 25 0 5 0 594212138 1048104960 227340 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1023540 CPUtime=694.55 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 105702 1254 0 0 69443 12 0 0 25 0 5 0 594212138 1048104960 227340 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2793.65
Current children cumulated vsize (KiB) 1023540

[startup+762.307 s]
/proc/loadavg: 8.12 7.97 7.84 9/186 28880
/proc/meminfo: memFree=19445160/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1085812 CPUtime=3033.35 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1498012 1254 0 0 303124 211 0 0 18 0 5 0 594211748 1111871488 242908 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 271453 242908 181 55 0 269339 0
[pid=28705/tid=28712] ppid=28703 vsize=1085812 CPUtime=758.42 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 432047 1254 0 0 75782 60 0 0 25 0 5 0 594212138 1111871488 242908 33554432000 4194304 4417332 140736369882416 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1085812 CPUtime=758.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 400025 1254 0 0 75780 58 0 0 25 0 5 0 594212138 1111871488 242908 33554432000 4194304 4417332 140736369882416 18446744073709551615 4275873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1085812 CPUtime=758.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 425640 1254 0 0 75780 60 0 0 25 0 5 0 594212138 1111871488 242908 33554432000 4194304 4417332 140736369882416 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1085812 CPUtime=754.23 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 138761 1254 0 0 75406 17 0 0 25 0 5 0 594212138 1111871488 242908 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3033.35
Current children cumulated vsize (KiB) 1085812

[startup+822.301 s]
/proc/loadavg: 8.04 7.97 7.84 9/186 28881
/proc/meminfo: memFree=19417344/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1110816 CPUtime=3273.01 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1567203 1254 0 0 327082 219 0 0 18 0 5 0 594211748 1137475584 249159 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 277704 249159 181 55 0 275590 0
[pid=28705/tid=28712] ppid=28703 vsize=1110816 CPUtime=818.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 433323 1254 0 0 81781 60 0 0 25 0 5 0 594212138 1137475584 249159 33554432000 4194304 4417332 140736369882416 18446744073709551615 4278246 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1110816 CPUtime=818.37 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 428667 1254 0 0 81776 61 0 0 25 0 5 0 594212138 1137475584 249159 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1110816 CPUtime=818.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 446170 1254 0 0 81777 63 0 0 25 0 5 0 594212138 1137475584 249159 33554432000 4194304 4417332 140736369882416 18446744073709551615 4264909 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1110816 CPUtime=813.9 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 157504 1254 0 0 81371 19 0 0 25 0 5 0 594212138 1137475584 249159 33554432000 4194304 4417332 140736369882416 18446744073709551615 18446744073699065955 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3273.01
Current children cumulated vsize (KiB) 1110816

[startup+882.3 s]
/proc/loadavg: 8.01 7.97 7.85 9/186 28883
/proc/meminfo: memFree=19502000/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1024836 CPUtime=3512.68 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1619820 1254 0 0 351041 227 0 0 18 0 5 0 594211748 1049432064 227664 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 256209 227664 181 55 0 254095 0
[pid=28705/tid=28712] ppid=28703 vsize=1024836 CPUtime=878.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 461965 1254 0 0 87777 64 0 0 25 0 5 0 594212138 1049432064 227664 33554432000 4194304 4417332 140736369882416 18446744073709551615 4365906 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1024836 CPUtime=878.37 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 429953 1254 0 0 87776 61 0 0 25 0 5 0 594212138 1049432064 227664 33554432000 4194304 4417332 140736369882416 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1024836 CPUtime=878.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 446170 1254 0 0 87777 63 0 0 25 0 5 0 594212138 1049432064 227664 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232693 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1024836 CPUtime=873.57 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 180193 1254 0 0 87334 23 0 0 25 0 5 0 594212138 1049432064 227664 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3512.68
Current children cumulated vsize (KiB) 1024836

[startup+942.3 s]
/proc/loadavg: 8.00 7.97 7.86 9/186 28884
/proc/meminfo: memFree=19353048/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1135232 CPUtime=3752.36 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1694233 1254 0 0 374998 238 0 0 18 0 5 0 594211748 1162477568 255263 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 283808 255263 181 55 0 281694 0
[pid=28705/tid=28712] ppid=28703 vsize=1135232 CPUtime=938.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 461965 1254 0 0 93777 64 0 0 25 0 5 0 594212138 1162477568 255263 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1135232 CPUtime=938.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 469232 1254 0 0 93772 66 0 0 25 0 5 0 594212138 1162477568 255263 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1135232 CPUtime=938.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 471640 1254 0 0 93774 66 0 0 25 0 5 0 594212138 1162477568 255263 33554432000 4194304 4417332 140736369882416 18446744073709551615 4320947 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1135232 CPUtime=933.24 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 189857 1254 0 0 93299 25 0 0 25 0 5 0 594212138 1162477568 255263 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3752.36
Current children cumulated vsize (KiB) 1135232

[startup+1002.3 s]
/proc/loadavg: 8.11 8.00 7.87 9/186 28886
/proc/meminfo: memFree=19190572/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1315564 CPUtime=3992.03 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1786183 1254 0 0 398952 251 0 0 18 0 5 0 594211748 1347137536 300346 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 328891 300346 181 55 0 326777 0
[pid=28705/tid=28712] ppid=28703 vsize=1315564 CPUtime=998.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 478417 1254 0 0 99775 66 0 0 25 0 5 0 594212138 1347137536 300346 33554432000 4194304 4417332 140736369882416 18446744073709551615 4357964 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1315564 CPUtime=998.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 485693 1254 0 0 99770 68 0 0 25 0 5 0 594212138 1347137536 300346 33554432000 4194304 4417332 140736369882416 18446744073709551615 4365390 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1315564 CPUtime=998.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 486004 1254 0 0 99772 68 0 0 25 0 5 0 594212138 1347137536 300346 33554432000 4194304 4417332 140736369882416 18446744073709551615 4264920 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1315564 CPUtime=992.91 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 234530 1254 0 0 99259 32 0 0 25 0 5 0 594212138 1347137536 300346 33554432000 4194304 4417332 140736369882416 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3992.03
Current children cumulated vsize (KiB) 1315564

[startup+1062.3 s]
/proc/loadavg: 8.11 8.02 7.88 9/186 28888
/proc/meminfo: memFree=19423160/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1082952 CPUtime=4231.71 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1811096 1254 0 0 422915 256 0 0 18 0 5 0 594211748 1108942848 242193 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 270738 242193 181 55 0 268624 0
[pid=28705/tid=28712] ppid=28703 vsize=1082952 CPUtime=1058.41 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 491157 1254 0 0 105773 68 0 0 25 0 5 0 594212138 1108942848 242193 33554432000 4194304 4417332 140736369882416 18446744073709551615 4365065 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1082952 CPUtime=1058.38 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 486804 1254 0 0 105770 68 0 0 25 0 5 0 594212138 1108942848 242193 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1082952 CPUtime=1058.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 486082 1254 0 0 105772 68 0 0 25 0 5 0 594212138 1108942848 242193 33554432000 4194304 4417332 140736369882416 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1082952 CPUtime=1052.58 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 245514 1254 0 0 105223 35 0 0 25 0 5 0 594212138 1108942848 242193 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4231.71
Current children cumulated vsize (KiB) 1082952

[startup+1122.3 s]
/proc/loadavg: 8.15 8.04 7.90 9/186 28889
/proc/meminfo: memFree=19194712/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1301780 CPUtime=4471.37 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1882272 1254 0 0 446871 266 0 0 18 0 5 0 594211748 1333022720 296900 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 325445 296900 181 55 0 323331 0
[pid=28705/tid=28712] ppid=28703 vsize=1301780 CPUtime=1118.42 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 509932 1254 0 0 111771 71 0 0 25 0 5 0 594212138 1333022720 296900 33554432000 4194304 4417332 140736369882416 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1301780 CPUtime=1118.39 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 499533 1254 0 0 111769 70 0 0 25 0 5 0 594212138 1333022720 296900 33554432000 4194304 4417332 140736369882416 18446744073709551615 4265499 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1301780 CPUtime=1118.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 486082 1254 0 0 111772 68 0 0 25 0 5 0 594212138 1333022720 296900 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1301780 CPUtime=1112.25 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 285186 1254 0 0 111183 42 0 0 25 0 5 0 594212138 1333022720 296900 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4471.37
Current children cumulated vsize (KiB) 1301780

[startup+1182.3 s]
/proc/loadavg: 8.16 8.06 7.91 9/186 28891
/proc/meminfo: memFree=19071544/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1432856 CPUtime=4711.06 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1958062 1254 0 0 470830 276 0 0 18 0 5 0 594211748 1467244544 329669 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 358214 329669 181 55 0 356100 0
[pid=28705/tid=28712] ppid=28703 vsize=1432856 CPUtime=1178.42 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 509932 1254 0 0 117771 71 0 0 25 0 5 0 594212138 1467244544 329669 33554432000 4194304 4417332 140736369882416 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1432856 CPUtime=1178.39 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 515919 1254 0 0 117766 73 0 0 25 0 5 0 594212138 1467244544 329669 33554432000 4194304 4417332 140736369882416 18446744073709551615 4346399 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1432856 CPUtime=1178.4 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 498813 1254 0 0 117771 69 0 0 25 0 5 0 594212138 1467244544 329669 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236655 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1432856 CPUtime=1171.92 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 331859 1254 0 0 117145 47 0 0 25 0 5 0 594212138 1467244544 329669 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4711.06
Current children cumulated vsize (KiB) 1432856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.6 s]
/proc/loadavg: 8.17 8.07 7.92 9/186 28891
/proc/meminfo: memFree=19074752/32950928 swapFree=67111524/67111528
[pid=28705] ppid=28703 vsize=1432572 CPUtime=4800.14 cores=0,2,4,6
/proc/28705/stat : 28705 (plingeling) S 28703 28705 28251 0 -1 4202496 1974448 1254 0 0 479736 278 0 0 18 0 5 0 594211748 1466953728 329598 33554432000 4194304 4417332 140736369882416 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28705/statm: 358143 329598 181 55 0 356029 0
[pid=28705/tid=28712] ppid=28703 vsize=1432572 CPUtime=1200.72 cores=0,2,4,6
/proc/28705/task/28712/stat : 28712 (plingeling) R 28703 28705 28251 0 -1 4202560 509932 1254 0 0 120001 71 0 0 25 0 5 0 594212138 1466953728 329598 33554432000 4194304 4417332 140736369882416 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28705/tid=28713] ppid=28703 vsize=1432572 CPUtime=1200.7 cores=0,2,4,6
/proc/28705/task/28713/stat : 28713 (plingeling) R 28703 28705 28251 0 -1 4202560 515919 1254 0 0 119997 73 0 0 25 0 5 0 594212138 1466953728 329598 33554432000 4194304 4417332 140736369882416 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28705/tid=28714] ppid=28703 vsize=1432572 CPUtime=1200.71 cores=0,2,4,6
/proc/28705/task/28714/stat : 28714 (plingeling) R 28703 28705 28251 0 -1 4202560 515199 1254 0 0 120000 71 0 0 25 0 5 0 594212138 1466953728 329598 33554432000 4194304 4417332 140736369882416 18446744073709551615 4236941 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28705/tid=28715] ppid=28703 vsize=1432572 CPUtime=1194.09 cores=0,2,4,6
/proc/28705/task/28715/stat : 28715 (plingeling) R 28703 28705 28251 0 -1 4202560 331859 1254 0 0 119362 47 0 0 25 0 5 0 594212138 1466953728 329598 33554432000 4194304 4417332 140736369882416 18446744073709551615 4320983 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 1432572

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.67
CPU time (s): 4800.24
CPU user time (s): 4797.39
CPU system time (s): 2.85057
CPU usage (%): 398.468
Max. virtual memory (cumulated for all children) (KiB): 1465344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.39
system time used= 2.85057
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1975702
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 144
involuntary context switches= 23312

runsolver used 1.92971 second user time and 4.6133 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 03:16:51
IDJOB=3281571
IDBENCH=69571
IDSOLVER=1605
FILE ID=node114/3281571-1304039809
RUNJOBID= node114-1304037280-28269
PBS_JOBID= 13170369
Free space on /tmp= 71716 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT_RACE08/cnf/velev-vliw-uns-4.0-9-i1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281571-1304039809/watcher-3281571-1304039809 -o /tmp/evaluation-result-3281571-1304039809/solver-3281571-1304039809 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3281571-1304039809.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 590cca3a58efdeb1c95ef988a53daa1d
RANDOM SEED=1167551714

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20155516 kB
Buffers:       2249712 kB
Cached:        9621316 kB
SwapCached:          4 kB
Active:        3717992 kB
Inactive:      8496204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20155516 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           81940 kB
Writeback:           0 kB
AnonPages:      342488 kB
Mapped:          15352 kB
Slab:           517268 kB
PageTables:       5368 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   543940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71736 MiB
End job on node114 at 2011-04-29 03:36:57