Trace number 3251516

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.19 1201.88

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p15-s54275047.cnf
MD5SUM67948a6aed9ea09317abe3c8a9a27a03
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.77358
Satisfiable
(Un)Satisfiability was proved
Number of variables1590
Number of clauses272291
Sum of the clauses size546092
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2272251
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251516-1304119378/watcher-3251516-1304119378 -o /tmp/evaluation-result-3251516-1304119378/solver-3251516-1304119378 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3251516-1304119378.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.10 8.02 5/181 5488
/proc/meminfo: memFree=22724204/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=9664 CPUtime=0 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) R 5486 5488 5295 0 -1 4202496 509 1254 0 0 0 0 0 0 25 0 1 0 523537476 9895936 437 33554432000 4194304 4417332 140735747331216 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/5488/statm: 2416 437 146 55 0 302 0

[startup+0.0793491 s]
/proc/loadavg: 8.13 8.10 8.02 5/181 5488
/proc/meminfo: memFree=22724204/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=23824 CPUtime=0.07 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) R 5486 5488 5295 0 -1 4202496 3984 1254 0 0 7 0 0 0 25 0 1 0 523537476 24395776 3864 33554432000 4194304 4417332 140735747331216 18446744073709551615 274473661533 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/5488/statm: 5956 3886 147 55 0 3842 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 23824

[startup+0.100343 s]
/proc/loadavg: 8.13 8.10 8.02 5/181 5488
/proc/meminfo: memFree=22724204/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=25872 CPUtime=0.09 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) R 5486 5488 5295 0 -1 4202496 4610 1254 0 0 9 0 0 0 25 0 1 0 523537476 26492928 4490 33554432000 4194304 4417332 140735747331216 18446744073709551615 4259875 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/5488/statm: 6468 4490 147 55 0 4354 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25872

[startup+0.30031 s]
/proc/loadavg: 8.13 8.10 8.02 5/181 5488
/proc/meminfo: memFree=22724204/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=85648 CPUtime=0.66 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 9696 1254 0 0 65 1 0 0 25 0 5 0 523537476 87703552 9225 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 21412 9225 174 55 0 19298 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 85648

[startup+0.700241 s]
/proc/loadavg: 8.13 8.10 8.02 5/181 5488
/proc/meminfo: memFree=22724204/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=96860 CPUtime=2.25 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 21157 1254 0 0 223 2 0 0 25 0 5 0 523537476 99184640 12001 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 24215 12001 179 55 0 22101 0
Current children cumulated CPU time (s) 2.25
Current children cumulated vsize (KiB) 96860

[startup+1.5011 s]
/proc/loadavg: 8.13 8.10 8.02 9/186 5498
/proc/meminfo: memFree=22661800/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=103196 CPUtime=5.45 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 24494 1254 0 0 542 3 0 0 25 0 5 0 523537476 105672704 13586 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 25799 13586 180 55 0 23685 0
[pid=5488/tid=5495] ppid=5486 vsize=103196 CPUtime=1.32 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 2858 1254 0 0 132 0 0 0 25 0 5 0 523537493 105672704 13586 33554432000 4194304 4417332 140735747331216 18446744073709551615 4236017 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=103196 CPUtime=1.3 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 2759 1254 0 0 130 0 0 0 25 0 5 0 523537493 105672704 13586 33554432000 4194304 4417332 140735747331216 18446744073709551615 4250341 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=103196 CPUtime=1.32 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 3367 1254 0 0 132 0 0 0 25 0 5 0 523537493 105672704 13586 33554432000 4194304 4417332 140735747331216 18446744073709551615 4377288 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=103196 CPUtime=1.32 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 6792 1254 0 0 131 1 0 0 25 0 5 0 523537493 105672704 13586 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 103196

[startup+3.10082 s]
/proc/loadavg: 8.13 8.10 8.02 9/186 5498
/proc/meminfo: memFree=22633668/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=123292 CPUtime=11.84 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 33797 1254 0 0 1180 4 0 0 25 0 5 0 523537476 126251008 18610 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 30823 18610 180 55 0 28709 0
[pid=5488/tid=5495] ppid=5486 vsize=123292 CPUtime=2.92 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 3604 1254 0 0 292 0 0 0 25 0 5 0 523537493 126251008 18610 33554432000 4194304 4417332 140735747331216 18446744073709551615 4236296 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=123292 CPUtime=2.9 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 3574 1254 0 0 290 0 0 0 25 0 5 0 523537493 126251008 18610 33554432000 4194304 4417332 140735747331216 18446744073709551615 4248888 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=123292 CPUtime=2.92 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 3367 1254 0 0 292 0 0 0 25 0 5 0 523537493 126251008 18610 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=123292 CPUtime=2.91 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 14534 1254 0 0 289 2 0 0 25 0 5 0 523537493 126251008 18610 33554432000 4194304 4417332 140735747331216 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.84
Current children cumulated vsize (KiB) 123292

[startup+6.30026 s]
/proc/loadavg: 8.12 8.09 8.02 9/186 5498
/proc/meminfo: memFree=22583324/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=126108 CPUtime=24.62 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 44964 1254 0 0 2456 6 0 0 25 0 5 0 523537476 129134592 19314 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 31527 19314 180 55 0 29413 0
[pid=5488/tid=5495] ppid=5486 vsize=126108 CPUtime=6.12 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 3604 1254 0 0 612 0 0 0 25 0 5 0 523537493 129134592 19314 33554432000 4194304 4417332 140735747331216 18446744073709551615 4258401 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=126108 CPUtime=6.08 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 3574 1254 0 0 608 0 0 0 25 0 5 0 523537493 129134592 19314 33554432000 4194304 4417332 140735747331216 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=126108 CPUtime=6.12 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 3367 1254 0 0 612 0 0 0 25 0 5 0 523537493 129134592 19314 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=126108 CPUtime=6.12 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 25701 1254 0 0 608 4 0 0 25 0 5 0 523537493 129134592 19314 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.62
Current children cumulated vsize (KiB) 126108

[startup+12.7011 s]
/proc/loadavg: 8.19 8.11 8.03 9/186 5498
/proc/meminfo: memFree=22545188/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=159164 CPUtime=50.19 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 64178 1254 0 0 5010 9 0 0 25 0 5 0 523537476 162983936 27570 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 39791 27570 180 55 0 37677 0
[pid=5488/tid=5495] ppid=5486 vsize=159164 CPUtime=12.52 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 3604 1254 0 0 1252 0 0 0 25 0 5 0 523537493 162983936 27570 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=159164 CPUtime=12.44 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 3574 1254 0 0 1244 0 0 0 25 0 5 0 523537493 162983936 27570 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249134 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=159164 CPUtime=12.52 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 4216 1254 0 0 1252 0 0 0 25 0 5 0 523537493 162983936 27570 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=159164 CPUtime=12.52 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 44066 1254 0 0 1245 7 0 0 25 0 5 0 523537493 162983936 27570 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.19
Current children cumulated vsize (KiB) 159164

[startup+25.5009 s]
/proc/loadavg: 8.15 8.10 8.02 9/186 5498
/proc/meminfo: memFree=22456512/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=284892 CPUtime=101.31 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 96861 1254 0 0 10118 13 0 0 25 0 5 0 523537476 291729408 42659 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 71223 42659 180 55 0 69109 0
[pid=5488/tid=5495] ppid=5486 vsize=284892 CPUtime=25.31 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 5494 1254 0 0 2531 0 0 0 25 0 5 0 523537493 291729408 42659 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=284892 CPUtime=25.17 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 3585 1254 0 0 2517 0 0 0 25 0 5 0 523537493 291729408 42659 33554432000 4194304 4417332 140735747331216 18446744073709551615 4366556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=284892 CPUtime=25.31 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 9646 1254 0 0 2531 0 0 0 25 0 5 0 523537493 291729408 42659 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=284892 CPUtime=25.31 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 69418 1254 0 0 2521 10 0 0 25 0 5 0 523537493 291729408 42659 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.31
Current children cumulated vsize (KiB) 284892

[startup+51.1004 s]
/proc/loadavg: 8.16 8.11 8.03 9/186 5499
/proc/meminfo: memFree=22283944/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=397016 CPUtime=203.57 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 158386 1254 0 0 20336 21 0 0 25 0 5 0 523537476 406544384 70690 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 99254 70690 180 55 0 97140 0
[pid=5488/tid=5495] ppid=5486 vsize=397016 CPUtime=50.91 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 5494 1254 0 0 5091 0 0 0 25 0 5 0 523537493 406544384 70690 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=397016 CPUtime=50.63 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 3654 1254 0 0 5063 0 0 0 25 0 5 0 523537493 406544384 70690 33554432000 4194304 4417332 140735747331216 18446744073709551615 4254833 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=397016 CPUtime=50.91 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 19717 1254 0 0 5090 1 0 0 25 0 5 0 523537493 406544384 70690 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=397016 CPUtime=50.91 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 120803 1254 0 0 5074 17 0 0 25 0 5 0 523537493 406544384 70690 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.57
Current children cumulated vsize (KiB) 397016

[startup+102.306 s]
/proc/loadavg: 8.19 8.12 8.03 9/186 5500
/proc/meminfo: memFree=22078840/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=424452 CPUtime=408.11 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 210273 1254 0 0 40782 29 0 0 25 0 5 0 523537476 434638848 77549 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 106113 77549 180 55 0 103999 0
[pid=5488/tid=5495] ppid=5486 vsize=424452 CPUtime=102.12 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 12341 1254 0 0 10211 1 0 0 25 0 5 0 523537493 434638848 77549 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=424452 CPUtime=101.55 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 12618 1254 0 0 10154 1 0 0 25 0 5 0 523537493 434638848 77549 33554432000 4194304 4417332 140735747331216 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=424452 CPUtime=102.12 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 23825 1254 0 0 10210 2 0 0 25 0 5 0 523537493 434638848 77549 33554432000 4194304 4417332 140735747331216 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=424452 CPUtime=102.12 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 152771 1254 0 0 10189 23 0 0 25 0 5 0 523537493 434638848 77549 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.11
Current children cumulated vsize (KiB) 424452

[startup+162.301 s]
/proc/loadavg: 8.18 8.13 8.04 9/186 5502
/proc/meminfo: memFree=21538148/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=655540 CPUtime=647.76 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 288393 1254 0 0 64736 40 0 0 25 0 5 0 523537476 671272960 135321 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 163885 135321 180 55 0 161771 0
[pid=5488/tid=5495] ppid=5486 vsize=655540 CPUtime=162.12 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 23193 1254 0 0 16209 3 0 0 25 0 5 0 523537493 671272960 135321 33554432000 4194304 4417332 140735747331216 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=655540 CPUtime=161.22 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 18503 1254 0 0 16120 2 0 0 25 0 5 0 523537493 671272960 135321 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=655540 CPUtime=162.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 41792 1254 0 0 16207 4 0 0 25 0 5 0 523537493 671272960 135321 33554432000 4194304 4417332 140735747331216 18446744073709551615 4310464 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=655540 CPUtime=162.12 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 196187 1254 0 0 16183 29 0 0 25 0 5 0 523537493 671272960 135321 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 647.76
Current children cumulated vsize (KiB) 655540


################
# More data... #
################

[pid=5488/tid=5496] ppid=5486 vsize=1333152 CPUtime=698.23 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 163488 1254 0 0 69801 22 0 0 25 0 5 0 523537493 1365147648 304724 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1333152 CPUtime=702.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 236401 1254 0 0 70182 29 0 0 25 0 5 0 523537493 1365147648 304724 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1333152 CPUtime=702.13 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 343349 1254 0 0 70161 52 0 0 25 0 5 0 523537493 1365147648 304724 33554432000 4194304 4417332 140735747331216 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2804.81
Current children cumulated vsize (KiB) 1333152

[startup+762.306 s]
/proc/loadavg: 8.13 8.09 8.04 10/186 5518
/proc/meminfo: memFree=19941096/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1341588 CPUtime=3044.49 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 990166 1254 0 0 304308 141 0 0 25 0 5 0 523537476 1373786112 306833 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 335397 306833 180 55 0 333283 0
[pid=5488/tid=5495] ppid=5486 vsize=1341588 CPUtime=762.13 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 129106 1254 0 0 76194 19 0 0 25 0 5 0 523537493 1373786112 306833 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1341588 CPUtime=757.91 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 231630 1254 0 0 75757 34 0 0 25 0 5 0 523537493 1373786112 306833 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1341588 CPUtime=762.12 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 260977 1254 0 0 76180 32 0 0 25 0 5 0 523537493 1373786112 306833 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1341588 CPUtime=762.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 359735 1254 0 0 76160 54 0 0 25 0 5 0 523537493 1373786112 306833 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.49
Current children cumulated vsize (KiB) 1341588

[startup+822.301 s]
/proc/loadavg: 8.16 8.10 8.04 9/186 5520
/proc/meminfo: memFree=19698520/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1491576 CPUtime=3284.14 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1048877 1254 0 0 328265 149 0 0 25 0 5 0 523537476 1527373824 340968 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 372894 340968 180 55 0 370780 0
[pid=5488/tid=5495] ppid=5486 vsize=1491576 CPUtime=822.13 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 137298 1254 0 0 82193 20 0 0 25 0 5 0 523537493 1527373824 340968 33554432000 4194304 4417332 140735747331216 18446744073709551615 4262960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1491576 CPUtime=817.57 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 242421 1254 0 0 81722 35 0 0 25 0 5 0 523537493 1527373824 340968 33554432000 4194304 4417332 140735747331216 18446744073709551615 274473661533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1491576 CPUtime=822.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 285553 1254 0 0 82176 35 0 0 25 0 5 0 523537493 1527373824 340968 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1491576 CPUtime=822.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 374887 1254 0 0 82157 57 0 0 25 0 5 0 523537493 1527373824 340968 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.14
Current children cumulated vsize (KiB) 1491576

[startup+882.301 s]
/proc/loadavg: 8.06 8.08 8.04 10/186 5521
/proc/meminfo: memFree=19204576/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1783944 CPUtime=3523.81 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1158340 1254 0 0 352213 168 0 0 25 0 5 0 523537476 1826758656 417422 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 445986 417422 180 55 0 443872 0
[pid=5488/tid=5495] ppid=5486 vsize=1783944 CPUtime=882.13 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 146095 1254 0 0 88192 21 0 0 25 0 5 0 523537493 1826758656 417422 33554432000 4194304 4417332 140735747331216 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1783944 CPUtime=877.23 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 266927 1254 0 0 87685 38 0 0 25 0 5 0 523537493 1826758656 417422 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1783944 CPUtime=882.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 314511 1254 0 0 88170 41 0 0 25 0 5 0 523537493 1826758656 417422 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1783944 CPUtime=882.13 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 422089 1254 0 0 88147 66 0 0 25 0 5 0 523537493 1826758656 417422 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3523.81
Current children cumulated vsize (KiB) 1783944

[startup+942.301 s]
/proc/loadavg: 8.02 8.06 8.03 9/186 5523
/proc/meminfo: memFree=18902840/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1802208 CPUtime=3763.49 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1187482 1254 0 0 376177 172 0 0 25 0 5 0 523537476 1845460992 421988 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 450552 421988 180 55 0 448438 0
[pid=5488/tid=5495] ppid=5486 vsize=1802208 CPUtime=942.13 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 146095 1254 0 0 94192 21 0 0 25 0 5 0 523537493 1845460992 421988 33554432000 4194304 4417332 140735747331216 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1802208 CPUtime=936.9 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 271493 1254 0 0 93652 38 0 0 25 0 5 0 523537493 1845460992 421988 33554432000 4194304 4417332 140735747331216 18446744073709551615 4353502 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1802208 CPUtime=942.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 339087 1254 0 0 94167 44 0 0 25 0 5 0 523537493 1845460992 421988 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1802208 CPUtime=942.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 422089 1254 0 0 94148 66 0 0 25 0 5 0 523537493 1845460992 421988 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.49
Current children cumulated vsize (KiB) 1802208

[startup+1002.3 s]
/proc/loadavg: 8.00 8.05 8.03 9/186 5524
/proc/meminfo: memFree=18468564/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1896340 CPUtime=4003.16 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1219207 1254 0 0 400139 177 0 0 25 0 5 0 523537476 1941852160 445521 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 474085 445521 180 55 0 471971 0
[pid=5488/tid=5495] ppid=5486 vsize=1896340 CPUtime=1002.13 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 153244 1254 0 0 100192 21 0 0 25 0 5 0 523537493 1941852160 445521 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1896340 CPUtime=996.56 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 271493 1254 0 0 99618 38 0 0 25 0 5 0 523537493 1941852160 445521 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1896340 CPUtime=1002.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 347279 1254 0 0 100166 45 0 0 25 0 5 0 523537493 1941852160 445521 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1896340 CPUtime=1002.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 438473 1254 0 0 100144 70 0 0 25 0 5 0 523537493 1941852160 445521 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4003.16
Current children cumulated vsize (KiB) 1896340

[startup+1062.3 s]
/proc/loadavg: 8.00 8.04 8.02 9/186 5526
/proc/meminfo: memFree=18555572/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1930720 CPUtime=4242.83 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1283743 1254 0 0 424097 186 0 0 25 0 5 0 523537476 1977057280 454116 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 482680 454116 180 55 0 480566 0
[pid=5488/tid=5495] ppid=5486 vsize=1930720 CPUtime=1062.14 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 167831 1254 0 0 106190 24 0 0 25 0 5 0 523537493 1977057280 454116 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364667 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1930720 CPUtime=1056.24 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 313250 1254 0 0 105580 44 0 0 25 0 5 0 523537493 1977057280 454116 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1930720 CPUtime=1062.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 355471 1254 0 0 106165 46 0 0 25 0 5 0 523537493 1977057280 454116 33554432000 4194304 4417332 140735747331216 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1930720 CPUtime=1062.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 438473 1254 0 0 106144 70 0 0 25 0 5 0 523537493 1977057280 454116 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4242.83
Current children cumulated vsize (KiB) 1930720

[startup+1122.3 s]
/proc/loadavg: 8.00 8.03 8.01 9/186 5528
/proc/meminfo: memFree=18849676/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1496036 CPUtime=4482.5 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1327229 1254 0 0 448053 197 0 0 25 0 5 0 523537476 1531940864 345445 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 374009 345445 180 55 0 371895 0
[pid=5488/tid=5495] ppid=5486 vsize=1496036 CPUtime=1122.14 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 169515 1254 0 0 112190 24 0 0 25 0 5 0 523537493 1531940864 345445 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1496036 CPUtime=1115.91 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 329634 1254 0 0 111543 48 0 0 25 0 5 0 523537493 1531940864 345445 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1496036 CPUtime=1122.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 356040 1254 0 0 112165 46 0 0 25 0 5 0 523537493 1531940864 345445 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1496036 CPUtime=1122.14 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 463322 1254 0 0 112138 76 0 0 25 0 5 0 523537493 1531940864 345445 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4482.5
Current children cumulated vsize (KiB) 1496036

[startup+1182.3 s]
/proc/loadavg: 8.00 8.02 8.01 9/186 5529
/proc/meminfo: memFree=19694444/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1548004 CPUtime=4722.17 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1391455 1254 0 0 472011 206 0 0 25 0 5 0 523537476 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 387001 358437 180 55 0 384887 0
[pid=5488/tid=5495] ppid=5486 vsize=1548004 CPUtime=1182.14 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 183968 1254 0 0 118188 26 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1548004 CPUtime=1175.58 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 370151 1254 0 0 117503 55 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1548004 CPUtime=1182.11 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 357178 1254 0 0 118165 46 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1548004 CPUtime=1182.15 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 471440 1254 0 0 118138 77 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4722.17
Current children cumulated vsize (KiB) 1548004



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 7.45 7.90 7.97 5/176 5548
/proc/meminfo: memFree=21398940/32950928 swapFree=67111524/67111528
[pid=5488] ppid=5486 vsize=1548004 CPUtime=4800.09 cores=0,2,4,6
/proc/5488/stat : 5488 (plingeling) S 5486 5488 5295 0 -1 4202496 1416031 1254 0 0 479800 209 0 0 25 0 5 0 523537476 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5488/statm: 387001 358437 180 55 0 384887 0
[pid=5488/tid=5495] ppid=5486 vsize=1548004 CPUtime=1201.65 cores=0,2,4,6
/proc/5488/task/5495/stat : 5495 (plingeling) R 5486 5488 5295 0 -1 4202560 183968 1254 0 0 120139 26 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5488/tid=5496] ppid=5486 vsize=1548004 CPUtime=1194.97 cores=0,2,4,6
/proc/5488/task/5496/stat : 5496 (plingeling) R 5486 5488 5295 0 -1 4202560 386535 1254 0 0 119441 56 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5488/tid=5497] ppid=5486 vsize=1548004 CPUtime=1201.62 cores=0,2,4,6
/proc/5488/task/5497/stat : 5497 (plingeling) R 5486 5488 5295 0 -1 4202560 365370 1254 0 0 120114 48 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5488/tid=5498] ppid=5486 vsize=1548004 CPUtime=1201.65 cores=0,2,4,6
/proc/5488/task/5498/stat : 5498 (plingeling) R 5486 5488 5295 0 -1 4202560 471440 1254 0 0 120088 77 0 0 25 0 5 0 523537493 1585156096 358437 33554432000 4194304 4417332 140735747331216 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1548004

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.88
CPU time (s): 4800.19
CPU user time (s): 4798.02
CPU system time (s): 2.16767
CPU usage (%): 399.39
Max. virtual memory (cumulated for all children) (KiB): 2064680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.02
system time used= 2.16767
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1417285
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58
involuntary context switches= 24660

runsolver used 2.05269 second user time and 4.50531 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-30 01:22:58
IDJOB=3251516
IDBENCH=88225
IDSOLVER=1605
FILE ID=node125/3251516-1304119378
RUNJOBID= node125-1304118165-5313
PBS_JOBID= 13170720
Free space on /tmp= 72756 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q585-n40-p15-s54275047.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251516-1304119378/watcher-3251516-1304119378 -o /tmp/evaluation-result-3251516-1304119378/solver-3251516-1304119378 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3251516-1304119378.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 67948a6aed9ea09317abe3c8a9a27a03
RANDOM SEED=150970400

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22724484 kB
Buffers:       2124748 kB
Cached:        7405368 kB
SwapCached:          4 kB
Active:        2234016 kB
Inactive:      7468864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22724484 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            7060 kB
Writeback:          16 kB
AnonPages:      171900 kB
Mapped:          15488 kB
Slab:           460796 kB
PageTables:       5048 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   357176 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72760 MiB
End job on node125 at 2011-04-30 01:43:02