Trace number 3257370

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.28 1201.68

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_11_3_4_cmp.cnf
MD5SUM3b5e80540ef2fcb09cfe50ac7e3686c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark135.155
Satisfiable
(Un)Satisfiability was proved
Number of variables8713
Number of clauses99699
Sum of the clauses size335345
Maximum clause length81
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210866
Number of clauses of size 367270
Number of clauses of size 410556
Number of clauses of size 510773
Number of clauses of size over 5234

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257370-1304043920/watcher-3257370-1304043920 -o /tmp/evaluation-result-3257370-1304043920/solver-3257370-1304043920 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3257370-1304043920.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.70 4.98 6.40 3/172 2946
/proc/meminfo: memFree=16827504/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=9852 CPUtime=0 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) R 2943 2946 1725 0 -1 4202496 555 1255 0 0 0 0 0 0 22 0 1 0 515991636 10088448 485 33554432000 4194304 4417332 140733257117808 18446744073709551615 210646840276 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/2946/statm: 2463 485 146 55 0 349 0

[startup+0.0652141 s]
/proc/loadavg: 3.70 4.98 6.40 3/172 2946
/proc/meminfo: memFree=16827504/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=24216 CPUtime=0.05 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) R 2943 2946 1725 0 -1 4202496 4165 1255 0 0 5 0 0 0 22 0 1 0 515991636 24797184 4078 33554432000 4194304 4417332 140733257117808 18446744073709551615 210646765024 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/2946/statm: 6054 4078 148 55 0 3940 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 24216

[startup+0.100204 s]
/proc/loadavg: 3.70 4.98 6.40 3/172 2946
/proc/meminfo: memFree=16827504/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=32408 CPUtime=0.08 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) R 2943 2946 1725 0 -1 4202496 6213 1255 0 0 8 0 0 0 22 0 1 0 515991636 33185792 6126 33554432000 4194304 4417332 140733257117808 18446744073709551615 210647146240 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/2946/statm: 8102 6126 148 55 0 5988 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 32408

[startup+0.300126 s]
/proc/loadavg: 3.70 4.98 6.40 3/172 2946
/proc/meminfo: memFree=16827504/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=75352 CPUtime=0.79 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 8407 1255 0 0 78 1 0 0 22 0 5 0 515991636 77160448 6653 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 18838 6653 175 55 0 16724 0
Current children cumulated CPU time (s) 0.79
Current children cumulated vsize (KiB) 75352

[startup+0.701058 s]
/proc/loadavg: 3.70 4.98 6.40 3/172 2946
/proc/meminfo: memFree=16827504/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=90052 CPUtime=2.38 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 15227 1255 0 0 237 1 0 0 22 0 5 0 515991636 92213248 10301 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 22513 10301 180 55 0 20399 0
Current children cumulated CPU time (s) 2.38
Current children cumulated vsize (KiB) 90052

[startup+1.50092 s]
/proc/loadavg: 3.70 4.98 6.40 9/184 2973
/proc/meminfo: memFree=16729068/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=99652 CPUtime=5.58 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 21458 1255 0 0 556 2 0 0 22 0 5 0 515991636 102043648 12713 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 24913 12713 180 55 0 22799 0
[pid=2946/tid=2966] ppid=2943 vsize=99652 CPUtime=1.36 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 2097 1255 0 0 136 0 0 0 25 0 5 0 515991649 102043648 12713 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=99652 CPUtime=1.36 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 2483 1255 0 0 136 0 0 0 25 0 5 0 515991649 102043648 12713 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=99652 CPUtime=1.35 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2440 1255 0 0 135 0 0 0 25 0 5 0 515991649 102043648 12713 33554432000 4194304 4417332 140733257117808 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=99652 CPUtime=1.36 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 7701 1255 0 0 136 0 0 0 25 0 5 0 515991649 102043648 12713 33554432000 4194304 4417332 140733257117808 18446744073709551615 4320823 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.58
Current children cumulated vsize (KiB) 99652

[startup+3.10066 s]
/proc/loadavg: 3.70 4.98 6.40 9/184 2973
/proc/meminfo: memFree=16706252/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=180112 CPUtime=11.98 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 28180 1255 0 0 1194 4 0 0 22 0 5 0 515991636 184434688 16477 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 45028 16477 180 55 0 42914 0
[pid=2946/tid=2966] ppid=2943 vsize=180112 CPUtime=2.96 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 3045 1255 0 0 296 0 0 0 25 0 5 0 515991649 184434688 16477 33554432000 4194304 4417332 140733257117808 18446744073709551615 18446744073699065887 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=180112 CPUtime=2.96 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 2704 1255 0 0 296 0 0 0 25 0 5 0 515991649 184434688 16477 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=180112 CPUtime=2.94 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2516 1255 0 0 294 0 0 0 25 0 5 0 515991649 184434688 16477 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364529 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=180112 CPUtime=2.96 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 13178 1255 0 0 294 2 0 0 25 0 5 0 515991649 184434688 16477 33554432000 4194304 4417332 140733257117808 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.98
Current children cumulated vsize (KiB) 180112

[startup+6.30112 s]
/proc/loadavg: 4.04 5.03 6.41 9/184 2973
/proc/meminfo: memFree=16675000/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=192856 CPUtime=24.76 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 38976 1255 0 0 2471 5 0 0 22 0 5 0 515991636 197484544 19663 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 48214 19663 180 55 0 46100 0
[pid=2946/tid=2966] ppid=2943 vsize=192856 CPUtime=6.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 3899 1255 0 0 616 0 0 0 25 0 5 0 515991649 197484544 19663 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=192856 CPUtime=6.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 2704 1255 0 0 616 0 0 0 25 0 5 0 515991649 197484544 19663 33554432000 4194304 4417332 140733257117808 18446744073709551615 4236870 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=192856 CPUtime=6.13 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2516 1255 0 0 613 0 0 0 25 0 5 0 515991649 197484544 19663 33554432000 4194304 4417332 140733257117808 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=192856 CPUtime=6.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 23120 1255 0 0 613 3 0 0 25 0 5 0 515991649 197484544 19663 33554432000 4194304 4417332 140733257117808 18446744073709551615 4250915 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.76
Current children cumulated vsize (KiB) 192856

[startup+12.701 s]
/proc/loadavg: 4.36 5.08 6.42 9/184 2974
/proc/meminfo: memFree=16607744/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=229952 CPUtime=50.32 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 62967 1255 0 0 5022 10 0 0 22 0 5 0 515991636 235470848 28937 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 57488 28937 180 55 0 55374 0
[pid=2946/tid=2966] ppid=2943 vsize=229952 CPUtime=12.56 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 9910 1255 0 0 1255 1 0 0 25 0 5 0 515991649 235470848 28937 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365379 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=229952 CPUtime=12.55 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 2704 1255 0 0 1255 0 0 0 25 0 5 0 515991649 235470848 28937 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=229952 CPUtime=12.49 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2516 1255 0 0 1249 0 0 0 25 0 5 0 515991649 235470848 28937 33554432000 4194304 4417332 140733257117808 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=229952 CPUtime=12.56 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 41100 1255 0 0 1250 6 0 0 25 0 5 0 515991649 235470848 28937 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364951 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.32
Current children cumulated vsize (KiB) 229952

[startup+25.5009 s]
/proc/loadavg: 5.24 5.24 6.45 9/184 2974
/proc/meminfo: memFree=16595268/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=240608 CPUtime=101.45 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 89574 1255 0 0 10131 14 0 0 22 0 5 0 515991636 246382592 31602 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 60152 31602 181 55 0 58038 0
[pid=2946/tid=2966] ppid=2943 vsize=240608 CPUtime=25.35 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 10078 1255 0 0 2534 1 0 0 25 0 5 0 515991649 246382592 31602 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=240608 CPUtime=25.35 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 2704 1255 0 0 2535 0 0 0 25 0 5 0 515991649 246382592 31602 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=240608 CPUtime=25.23 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2516 1255 0 0 2523 0 0 0 25 0 5 0 515991649 246382592 31602 33554432000 4194304 4417332 140733257117808 18446744073709551615 4352289 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=240608 CPUtime=25.35 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 67539 1255 0 0 2525 10 0 0 25 0 5 0 515991649 246382592 31602 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.45
Current children cumulated vsize (KiB) 240608

[startup+51.1006 s]
/proc/loadavg: 6.25 5.48 6.50 9/184 2974
/proc/meminfo: memFree=16545692/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=264332 CPUtime=203.73 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 141602 1255 0 0 20353 20 0 0 22 0 5 0 515991636 270675968 37539 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 66083 37539 181 55 0 63969 0
[pid=2946/tid=2966] ppid=2943 vsize=264332 CPUtime=50.95 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 10568 1255 0 0 5094 1 0 0 25 0 5 0 515991649 270675968 37539 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=264332 CPUtime=50.95 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 3106 1255 0 0 5095 0 0 0 25 0 5 0 515991649 270675968 37539 33554432000 4194304 4417332 140733257117808 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=264332 CPUtime=50.71 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 2522 1255 0 0 5071 0 0 0 25 0 5 0 515991649 270675968 37539 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=264332 CPUtime=50.95 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 118669 1255 0 0 5079 16 0 0 25 0 5 0 515991649 270675968 37539 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.73
Current children cumulated vsize (KiB) 264332

[startup+102.306 s]
/proc/loadavg: 7.28 5.88 6.58 9/184 2976
/proc/meminfo: memFree=16493348/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=336912 CPUtime=408.31 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 213113 1255 0 0 40800 31 0 0 22 0 5 0 515991636 344997888 55684 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 84228 55684 181 55 0 82114 0
[pid=2946/tid=2966] ppid=2943 vsize=336912 CPUtime=102.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 14740 1255 0 0 10214 2 0 0 25 0 5 0 515991649 344997888 55684 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365070 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=336912 CPUtime=102.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 5575 1255 0 0 10216 0 0 0 25 0 5 0 515991649 344997888 55684 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=336912 CPUtime=101.67 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 3059 1255 0 0 10167 0 0 0 25 0 5 0 515991649 344997888 55684 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=336912 CPUtime=102.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 183002 1255 0 0 10190 26 0 0 25 0 5 0 515991649 344997888 55684 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.31
Current children cumulated vsize (KiB) 336912

[startup+162.301 s]
/proc/loadavg: 7.83 6.29 6.67 9/184 2978
/proc/meminfo: memFree=16298788/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=506360 CPUtime=648.01 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 285681 1255 0 0 64759 42 0 0 22 0 5 0 515991636 518512640 98046 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 126590 98046 181 55 0 124476 0
[pid=2946/tid=2966] ppid=2943 vsize=506360 CPUtime=162.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 16862 1255 0 0 16213 3 0 0 25 0 5 0 515991649 518512640 98046 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=506360 CPUtime=162.15 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 5575 1255 0 0 16215 0 0 0 25 0 5 0 515991649 518512640 98046 33554432000 4194304 4417332 140733257117808 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=506360 CPUtime=161.38 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 5107 1255 0 0 16138 0 0 0 25 0 5 0 515991649 518512640 98046 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=506360 CPUtime=162.15 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 251400 1255 0 0 16179 36 0 0 25 0 5 0 515991649 518512640 98046 33554432000 4194304 4417332 140733257117808 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.01
Current children cumulated vsize (KiB) 506360


################
# More data... #
################

[pid=2946/tid=2967] ppid=2943 vsize=1117516 CPUtime=702.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 34783 1255 0 0 70213 3 0 0 25 0 5 0 515991649 1144336384 250835 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1117516 CPUtime=698.74 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 31999 1255 0 0 69869 5 0 0 25 0 5 0 515991649 1144336384 250835 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232821 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1117516 CPUtime=702.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 503896 1255 0 0 70143 73 0 0 25 0 5 0 515991649 1144336384 250835 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.38
Current children cumulated vsize (KiB) 1117516

[startup+762.306 s]
/proc/loadavg: 8.05 7.83 7.33 9/184 2994
/proc/meminfo: memFree=15706400/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=825636 CPUtime=3045.11 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 706142 1255 0 0 304407 104 0 0 22 0 5 0 515991636 845451264 177865 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 206409 177865 181 55 0 204295 0
[pid=2946/tid=2966] ppid=2943 vsize=825636 CPUtime=762.17 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 78066 1255 0 0 76207 10 0 0 25 0 5 0 515991649 845451264 177865 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=825636 CPUtime=762.17 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 47073 1255 0 0 76212 5 0 0 25 0 5 0 515991649 845451264 177865 33554432000 4194304 4417332 140733257117808 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=825636 CPUtime=758.45 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 41526 1255 0 0 75838 7 0 0 25 0 5 0 515991649 845451264 177865 33554432000 4194304 4417332 140733257117808 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=825636 CPUtime=762.17 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 532740 1255 0 0 76137 80 0 0 25 0 5 0 515991649 845451264 177865 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3045.11
Current children cumulated vsize (KiB) 825636

[startup+822.301 s]
/proc/loadavg: 8.07 7.88 7.37 9/184 2995
/proc/meminfo: memFree=15518280/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=956368 CPUtime=3284.79 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 759457 1255 0 0 328368 111 0 0 22 0 5 0 515991636 979320832 210548 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 239092 210548 181 55 0 236978 0
[pid=2946/tid=2966] ppid=2943 vsize=956368 CPUtime=822.17 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 80002 1255 0 0 82207 10 0 0 25 0 5 0 515991649 979320832 210548 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=956368 CPUtime=822.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 51169 1255 0 0 82211 5 0 0 25 0 5 0 515991649 979320832 210548 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=956368 CPUtime=818.14 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 55699 1255 0 0 81805 9 0 0 25 0 5 0 515991649 979320832 210548 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=956368 CPUtime=822.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 565850 1255 0 0 82132 84 0 0 25 0 5 0 515991649 979320832 210548 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.79
Current children cumulated vsize (KiB) 956368

[startup+882.301 s]
/proc/loadavg: 8.08 7.91 7.41 9/184 2997
/proc/meminfo: memFree=15149756/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1065796 CPUtime=3524.46 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 809278 1255 0 0 352327 119 0 0 22 0 5 0 515991636 1091375104 237905 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 266449 237905 181 55 0 264335 0
[pid=2946/tid=2966] ppid=2943 vsize=1065796 CPUtime=882.17 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 84098 1255 0 0 88206 11 0 0 25 0 5 0 515991649 1091375104 237905 33554432000 4194304 4417332 140733257117808 18446744073709551615 4263206 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1065796 CPUtime=882.17 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 55265 1255 0 0 88211 6 0 0 25 0 5 0 515991649 1091375104 237905 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1065796 CPUtime=877.82 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 77731 1255 0 0 87769 13 0 0 25 0 5 0 515991649 1091375104 237905 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1065796 CPUtime=882.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 585447 1255 0 0 88129 87 0 0 25 0 5 0 515991649 1091375104 237905 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.46
Current children cumulated vsize (KiB) 1065796

[startup+942.301 s]
/proc/loadavg: 8.03 7.92 7.45 9/184 2998
/proc/meminfo: memFree=15046460/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1237932 CPUtime=3764.19 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 872504 1255 0 0 376290 129 0 0 22 0 5 0 515991636 1267642368 280939 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 309483 280939 181 55 0 307369 0
[pid=2946/tid=2966] ppid=2943 vsize=1237932 CPUtime=942.17 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 90842 1255 0 0 94206 11 0 0 25 0 5 0 515991649 1267642368 280939 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1237932 CPUtime=942.17 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 55265 1255 0 0 94211 6 0 0 25 0 5 0 515991649 1267642368 280939 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364776 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1237932 CPUtime=937.54 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 91565 1255 0 0 93739 15 0 0 25 0 5 0 515991649 1267642368 280939 33554432000 4194304 4417332 140733257117808 18446744073709551615 4250488 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1237932 CPUtime=942.15 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 628095 1255 0 0 94121 94 0 0 25 0 5 0 515991649 1267642368 280939 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364887 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3764.19
Current children cumulated vsize (KiB) 1237932

[startup+1002.3 s]
/proc/loadavg: 8.09 7.96 7.49 9/184 3000
/proc/meminfo: memFree=14790772/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1274964 CPUtime=4003.9 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 885634 1255 0 0 400259 131 0 0 22 0 5 0 515991636 1305563136 290197 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 318741 290197 181 55 0 316627 0
[pid=2946/tid=2966] ppid=2943 vsize=1274964 CPUtime=1002.17 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 90842 1255 0 0 100206 11 0 0 25 0 5 0 515991649 1305563136 290197 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1274964 CPUtime=1002.17 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 55265 1255 0 0 100211 6 0 0 25 0 5 0 515991649 1305563136 290197 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1274964 CPUtime=997.25 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 103431 1255 0 0 99708 17 0 0 25 0 5 0 515991649 1305563136 290197 33554432000 4194304 4417332 140733257117808 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1274964 CPUtime=1002.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 629359 1255 0 0 100121 95 0 0 25 0 5 0 515991649 1305563136 290197 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.9
Current children cumulated vsize (KiB) 1274964

[startup+1062.3 s]
/proc/loadavg: 8.07 7.98 7.52 9/184 3002
/proc/meminfo: memFree=14303820/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1726224 CPUtime=4243.61 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 1081265 1255 0 0 424201 160 0 0 22 0 5 0 515991636 1767653376 403012 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 431556 403012 181 55 0 429442 0
[pid=2946/tid=2966] ppid=2943 vsize=1726224 CPUtime=1062.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 131812 1255 0 0 106201 15 0 0 25 0 5 0 515991649 1767653376 403012 33554432000 4194304 4417332 140733257117808 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1726224 CPUtime=1062.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 73270 1255 0 0 106208 8 0 0 25 0 5 0 515991649 1767653376 403012 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1726224 CPUtime=1056.98 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 191519 1255 0 0 105667 31 0 0 25 0 5 0 515991649 1767653376 403012 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1726224 CPUtime=1062.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 677927 1255 0 0 106112 104 0 0 25 0 5 0 515991649 1767653376 403012 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.61
Current children cumulated vsize (KiB) 1726224

[startup+1122.3 s]
/proc/loadavg: 8.06 8.00 7.56 9/184 3003
/proc/meminfo: memFree=14188248/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1660784 CPUtime=4483.33 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 1220441 1255 0 0 448153 180 0 0 22 0 5 0 515991636 1700642816 386652 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 415196 386652 181 55 0 413082 0
[pid=2946/tid=2966] ppid=2943 vsize=1660784 CPUtime=1122.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 194584 1255 0 0 112193 23 0 0 25 0 5 0 515991649 1700642816 386652 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1660784 CPUtime=1122.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 86898 1255 0 0 112207 9 0 0 25 0 5 0 515991649 1700642816 386652 33554432000 4194304 4417332 140733257117808 18446744073709551615 4232577 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1660784 CPUtime=1116.69 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 251423 1255 0 0 111629 40 0 0 25 0 5 0 515991649 1700642816 386652 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1660784 CPUtime=1122.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 680799 1255 0 0 112112 104 0 0 25 0 5 0 515991649 1700642816 386652 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4483.33
Current children cumulated vsize (KiB) 1660784

[startup+1182.3 s]
/proc/loadavg: 8.20 8.04 7.60 9/184 3005
/proc/meminfo: memFree=13882320/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1944224 CPUtime=4723.05 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 1291301 1255 0 0 472116 189 0 0 22 0 5 0 515991636 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 486056 457512 181 55 0 483942 0
[pid=2946/tid=2966] ppid=2943 vsize=1944224 CPUtime=1182.16 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 210323 1255 0 0 118191 25 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4264914 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1944224 CPUtime=1182.16 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 119670 1255 0 0 118203 13 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4310588 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1944224 CPUtime=1176.41 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 273772 1255 0 0 117598 43 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4309869 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1944224 CPUtime=1182.16 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 680799 1255 0 0 118112 104 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4723.05
Current children cumulated vsize (KiB) 1944224



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 8.14 8.04 7.60 9/184 3005
/proc/meminfo: memFree=13882324/32951132 swapFree=67111524/67111528
[pid=2946] ppid=2943 vsize=1944224 CPUtime=4800.18 cores=1,3,5,7
/proc/2946/stat : 2946 (plingeling) S 2943 2946 1725 0 -1 4202496 1291301 1255 0 0 479829 189 0 0 22 0 5 0 515991636 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/2946/statm: 486056 457512 181 55 0 483942 0
[pid=2946/tid=2966] ppid=2943 vsize=1944224 CPUtime=1201.47 cores=1,3,5,7
/proc/2946/task/2966/stat : 2966 (plingeling) R 2943 2946 1725 0 -1 4202560 210323 1255 0 0 120122 25 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2946/tid=2967] ppid=2943 vsize=1944224 CPUtime=1201.46 cores=1,3,5,7
/proc/2946/task/2967/stat : 2967 (plingeling) R 2943 2946 1725 0 -1 4202560 119670 1255 0 0 120133 13 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4310626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2946/tid=2968] ppid=2943 vsize=1944224 CPUtime=1195.62 cores=1,3,5,7
/proc/2946/task/2968/stat : 2968 (plingeling) R 2943 2946 1725 0 -1 4202560 273772 1255 0 0 119519 43 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4309880 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2946/tid=2969] ppid=2943 vsize=1944224 CPUtime=1201.46 cores=1,3,5,7
/proc/2946/task/2969/stat : 2969 (plingeling) R 2943 2946 1725 0 -1 4202560 680799 1255 0 0 120042 104 0 0 25 0 5 0 515991649 1990885376 457512 33554432000 4194304 4417332 140733257117808 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 1944224

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.68
CPU time (s): 4800.28
CPU user time (s): 4798.32
CPU system time (s): 1.9617
CPU usage (%): 399.464
Max. virtual memory (cumulated for all children) (KiB): 1944224

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.32
system time used= 1.9617
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1292556
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129
involuntary context switches= 36530

runsolver used 1.75373 second user time and 3.97939 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 04:25:20
IDJOB=3257370
IDBENCH=70910
IDSOLVER=1605
FILE ID=node129/3257370-1304043920
RUNJOBID= node129-1304043920-2932
PBS_JOBID= 13170362
Free space on /tmp= 66368 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_11_3_4_cmp.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257370-1304043920/watcher-3257370-1304043920 -o /tmp/evaluation-result-3257370-1304043920/solver-3257370-1304043920 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3257370-1304043920.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3b5e80540ef2fcb09cfe50ac7e3686c1
RANDOM SEED=833021683

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16827776 kB
Buffers:       1277408 kB
Cached:       14113516 kB
SwapCached:          4 kB
Active:        3744900 kB
Inactive:     11714036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16827776 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            4576 kB
Writeback:           0 kB
AnonPages:       67580 kB
Mapped:          14788 kB
Slab:           602472 kB
PageTables:       4416 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   191404 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66364 MiB
End job on node129 at 2011-04-29 04:45:24