Trace number 3371416

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.36 1208.66

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
blocks-blocks-36-0.120-NOTKNOWN.cnf
MD5SUM8d94c04f870c828c80bd9a45ae3dedff
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark603.823
Satisfiable
(Un)Satisfiability was proved
Number of variables489685
Number of clauses8779920
Sum of the clauses size19139520
Maximum clause length1334
Minimum clause length1
Number of clauses of size 11440
Number of clauses of size 28441280
Number of clauses of size 3319680
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371416-1305420909/watcher-3371416-1305420909 -o /tmp/evaluation-result-3371416-1305420909/solver-3371416-1305420909 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371416-1305420909.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 6.23 6.51 5/299 4252
/proc/meminfo: memFree=12432184/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=14476 CPUtime=0 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 1419 1260 0 0 0 0 0 0 23 0 1 0 653691031 14823424 1349 33554432000 4194304 4417452 140736535006368 18446744073709551615 208079926365 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 3619 1362 139 55 0 1505 0

[startup+0.090449 s]
/proc/loadavg: 7.48 6.23 6.51 5/299 4252
/proc/meminfo: memFree=12432184/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=21920 CPUtime=0.08 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 3542 1260 0 0 8 0 0 0 23 0 1 0 653691031 22446080 3472 33554432000 4194304 4417452 140736535006368 18446744073709551615 4231283 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 5480 3472 149 55 0 3366 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 21920

[startup+0.100446 s]
/proc/loadavg: 7.48 6.23 6.51 5/299 4252
/proc/meminfo: memFree=12432184/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=25648 CPUtime=0.09 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 4506 1260 0 0 9 0 0 0 24 0 1 0 653691031 26263552 4436 33554432000 4194304 4417452 140736535006368 18446744073709551615 4209709 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 6412 4436 149 55 0 4298 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25648

[startup+0.300409 s]
/proc/loadavg: 7.48 6.23 6.51 5/299 4252
/proc/meminfo: memFree=12432184/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=40796 CPUtime=0.29 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 8309 1260 0 0 28 1 0 0 25 0 1 0 653691031 41775104 8223 33554432000 4194304 4417452 140736535006368 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 10199 8223 149 55 0 8085 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 40796

[startup+0.700333 s]
/proc/loadavg: 7.48 6.23 6.51 5/299 4252
/proc/meminfo: memFree=12432184/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=76340 CPUtime=0.68 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 17275 1260 0 0 66 2 0 0 25 0 1 0 653691031 78172160 17109 33554432000 4194304 4417452 140736535006368 18446744073709551615 208079851133 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 19085 17109 149 55 0 16971 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 76340

[startup+1.50018 s]
/proc/loadavg: 7.48 6.23 6.51 6/300 4258
/proc/meminfo: memFree=12346980/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=127540 CPUtime=1.49 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 30075 1260 0 0 144 5 0 0 25 0 1 0 653691031 130600960 29909 33554432000 4194304 4417452 140736535006368 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 31885 29909 149 55 0 29771 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 127540

[startup+3.10087 s]
/proc/loadavg: 7.48 6.23 6.51 6/300 4258
/proc/meminfo: memFree=12203620/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=365268 CPUtime=3.09 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 89532 1260 0 0 295 14 0 0 25 0 1 0 653691031 374034432 89341 33554432000 4194304 4417452 140736535006368 18446744073709551615 4259826 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 91317 89341 149 55 0 89203 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 365268

[startup+6.30027 s]
/proc/loadavg: 7.28 6.21 6.51 6/300 4258
/proc/meminfo: memFree=11729988/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=710464 CPUtime=6.29 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) R 4250 4252 3297 0 -1 4202496 175999 1260 0 0 602 27 0 0 25 0 1 0 653691031 727515136 175640 33554432000 4194304 4417452 140736535006368 18446744073709551615 4235997 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/4252/statm: 177616 175640 149 55 0 175502 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 710464

[startup+12.7011 s]
/proc/loadavg: 7.34 6.24 6.51 9/304 4263
/proc/meminfo: memFree=11535440/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1087272 CPUtime=28.63 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 298328 1260 0 0 2814 49 0 0 25 0 5 0 653691031 1113366528 227394 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 271818 227394 177 55 0 269704 0
[pid=4252/tid=4259] ppid=4250 vsize=1087272 CPUtime=5.33 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 35907 1260 0 0 527 6 0 0 25 0 5 0 653691767 1113366528 227394 33554432000 4194304 4417452 140736535006368 18446744073709551615 4274913 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1087272 CPUtime=5.32 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 31586 1260 0 0 528 4 0 0 25 0 5 0 653691767 1113366528 227394 33554432000 4194304 4417452 140736535006368 18446744073709551615 4260023 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1087272 CPUtime=5.28 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 42179 1260 0 0 520 8 0 0 25 0 5 0 653691767 1113366528 227394 33554432000 4194304 4417452 140736535006368 18446744073709551615 208080290218 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1087272 CPUtime=5.33 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 8549 1260 0 0 532 1 0 0 25 0 5 0 653691767 1113366528 227394 33554432000 4194304 4417452 140736535006368 18446744073709551615 4251081 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 28.63
Current children cumulated vsize (KiB) 1087272

[startup+25.5006 s]
/proc/loadavg: 7.48 6.32 6.54 9/304 4263
/proc/meminfo: memFree=11669988/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=923100 CPUtime=79.71 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 360719 1260 0 0 7910 61 0 0 25 0 5 0 653691031 945254400 185607 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 230775 185607 180 55 0 228661 0
[pid=4252/tid=4259] ppid=4250 vsize=923100 CPUtime=18.12 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 64677 1260 0 0 1801 11 0 0 25 0 5 0 653691767 945254400 185607 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=923100 CPUtime=18.11 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 51440 1260 0 0 1803 8 0 0 25 0 5 0 653691767 945254400 185607 33554432000 4194304 4417452 140736535006368 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=923100 CPUtime=17.96 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 55946 1260 0 0 1786 10 0 0 25 0 5 0 653691767 945254400 185607 33554432000 4194304 4417452 140736535006368 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=923100 CPUtime=18.13 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 8549 1260 0 0 1812 1 0 0 25 0 5 0 653691767 945254400 185607 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281860 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 79.71
Current children cumulated vsize (KiB) 923100

[startup+51.1117 s]
/proc/loadavg: 7.66 6.46 6.57 9/304 4264
/proc/meminfo: memFree=11656248/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=910072 CPUtime=181.83 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 367488 1260 0 0 18122 61 0 0 25 0 5 0 653691031 931913728 184020 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 227518 184020 180 55 0 225404 0
[pid=4252/tid=4259] ppid=4250 vsize=910072 CPUtime=43.73 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 70233 1260 0 0 4362 11 0 0 25 0 5 0 653691767 931913728 184020 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236655 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=910072 CPUtime=43.67 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 51440 1260 0 0 4359 8 0 0 25 0 5 0 653691767 931913728 184020 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236784 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=910072 CPUtime=43.31 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 55946 1260 0 0 4321 10 0 0 25 0 5 0 653691767 931913728 184020 33554432000 4194304 4417452 140736535006368 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=910072 CPUtime=43.73 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 9762 1260 0 0 4372 1 0 0 25 0 5 0 653691767 931913728 184020 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364446 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 181.83
Current children cumulated vsize (KiB) 910072

[startup+102.301 s]
/proc/loadavg: 7.92 6.71 6.65 9/304 4265
/proc/meminfo: memFree=11471136/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=982040 CPUtime=386.11 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 506598 1260 0 0 38525 86 0 0 25 0 5 0 653691031 1005608960 213146 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 245510 213146 180 55 0 243396 0
[pid=4252/tid=4259] ppid=4250 vsize=982040 CPUtime=94.92 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 116089 1260 0 0 9473 19 0 0 25 0 5 0 653691767 1005608960 213146 33554432000 4194304 4417452 140736535006368 18446744073709551615 4263206 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=982040 CPUtime=94.86 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 95861 1260 0 0 9470 16 0 0 25 0 5 0 653691767 1005608960 213146 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=982040 CPUtime=94.01 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 98215 1260 0 0 9384 17 0 0 25 0 5 0 653691767 1005608960 213146 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281857 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=982040 CPUtime=94.92 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 16326 1260 0 0 9490 2 0 0 25 0 5 0 653691767 1005608960 213146 33554432000 4194304 4417452 140736535006368 18446744073709551615 4356901 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 386.11
Current children cumulated vsize (KiB) 982040

[startup+162.301 s]
/proc/loadavg: 8.04 6.96 6.74 9/304 4267
/proc/meminfo: memFree=11424956/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1003776 CPUtime=625.55 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 536402 1260 0 0 62465 90 0 0 25 0 5 0 653691031 1027866624 216495 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 250944 216495 180 55 0 248830 0
[pid=4252/tid=4259] ppid=4250 vsize=1003776 CPUtime=154.93 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 127630 1260 0 0 15472 21 0 0 25 0 5 0 653691767 1027866624 216495 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364500 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1003776 CPUtime=154.86 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 95861 1260 0 0 15470 16 0 0 25 0 5 0 653691767 1027866624 216495 33554432000 4194304 4417452 140736535006368 18446744073709551615 4353543 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1003776 CPUtime=153.44 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 109694 1260 0 0 15325 19 0 0 25 0 5 0 653691767 1027866624 216495 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1003776 CPUtime=154.92 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 23110 1260 0 0 15490 2 0 0 25 0 5 0 653691767 1027866624 216495 33554432000 4194304 4417452 140736535006368 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 625.55
Current children cumulated vsize (KiB) 1003776

[startup+222.301 s]
/proc/loadavg: 8.12 7.17 6.83 9/304 4268
/proc/meminfo: memFree=11417836/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1006776 CPUtime=865 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 700826 1260 0 0 86385 115 0 0 25 0 5 0 653691031 1030938624 221962 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 251694 221962 180 55 0 249580 0
[pid=4252/tid=4259] ppid=4250 vsize=1006776 CPUtime=214.93 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 196533 1260 0 0 21462 31 0 0 25 0 5 0 653691767 1030938624 221962 33554432000 4194304 4417452 140736535006368 18446744073709551615 4320876 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1006776 CPUtime=214.86 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 129566 1260 0 0 21465 21 0 0 25 0 5 0 653691767 1030938624 221962 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236784 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1006776 CPUtime=212.89 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 171510 1260 0 0 21260 29 0 0 25 0 5 0 653691767 1030938624 221962 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1006776 CPUtime=214.92 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 23110 1260 0 0 21490 2 0 0 25 0 5 0 653691767 1030938624 221962 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 865
Current children cumulated vsize (KiB) 1006776

[startup+282.301 s]
/proc/loadavg: 8.14 7.35 6.91 9/304 4270
/proc/meminfo: memFree=11248908/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1082056 CPUtime=1104.43 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 746065 1260 0 0 110321 122 0 0 25 0 5 0 653691031 1108025344 241617 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 270514 241617 180 55 0 268400 0
[pid=4252/tid=4259] ppid=4250 vsize=1082056 CPUtime=274.93 cores=1,3,5,7

################
# More data... #
################

[pid=4252/tid=4260] ppid=4250 vsize=1280308 CPUtime=754.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 244093 1260 0 0 75450 37 0 0 25 0 5 0 653691767 1311035392 276845 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1280308 CPUtime=747.54 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 359112 1260 0 0 74700 54 0 0 25 0 5 0 653691767 1311035392 276845 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1280308 CPUtime=754.39 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 64478 1260 0 0 75431 8 0 0 25 0 5 0 653691767 1311035392 276845 33554432000 4194304 4417452 140736535006368 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3019.13
Current children cumulated vsize (KiB) 1280308

[startup+822.301 s]
/proc/loadavg: 8.13 7.98 7.42 9/304 4296
/proc/meminfo: memFree=10642128/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1340928 CPUtime=3258.58 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1218264 1260 0 0 325673 185 0 0 25 0 5 0 653691031 1373110272 290172 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 335232 290172 180 55 0 333118 0
[pid=4252/tid=4259] ppid=4250 vsize=1340928 CPUtime=814.95 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 344791 1260 0 0 81443 52 0 0 25 0 5 0 653691767 1373110272 290172 33554432000 4194304 4417452 140736535006368 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1340928 CPUtime=814.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 252153 1260 0 0 81449 38 0 0 25 0 5 0 653691767 1373110272 290172 33554432000 4194304 4417452 140736535006368 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1340928 CPUtime=807.54 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 359752 1260 0 0 80700 54 0 0 25 0 5 0 653691767 1373110272 290172 33554432000 4194304 4417452 140736535006368 18446744073709551615 4232629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1340928 CPUtime=813.84 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 81461 1260 0 0 81373 11 0 0 25 0 5 0 653691767 1373110272 290172 33554432000 4194304 4417452 140736535006368 18446744073709551615 4353636 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3258.58
Current children cumulated vsize (KiB) 1340928

[startup+882.3 s]
/proc/loadavg: 8.12 8.00 7.46 9/304 4298
/proc/meminfo: memFree=10699116/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1329012 CPUtime=3498.04 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1354502 1260 0 0 349599 205 0 0 25 0 5 0 653691031 1360908288 287193 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 332253 287193 180 55 0 330139 0
[pid=4252/tid=4259] ppid=4250 vsize=1329012 CPUtime=874.96 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 394131 1260 0 0 87437 59 0 0 25 0 5 0 653691767 1360908288 287193 33554432000 4194304 4417452 140736535006368 18446744073709551615 4235378 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1329012 CPUtime=874.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 310652 1260 0 0 87441 46 0 0 25 0 5 0 653691767 1360908288 287193 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1329012 CPUtime=867.55 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 376317 1260 0 0 86698 57 0 0 25 0 5 0 653691767 1360908288 287193 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1329012 CPUtime=873.29 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 93295 1260 0 0 87317 12 0 0 25 0 5 0 653691767 1360908288 287193 33554432000 4194304 4417452 140736535006368 18446744073709551615 4354481 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3498.04
Current children cumulated vsize (KiB) 1329012

[startup+942.301 s]
/proc/loadavg: 8.11 8.01 7.50 9/304 4299
/proc/meminfo: memFree=10832612/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1274256 CPUtime=3737.48 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1367834 1260 0 0 373541 207 0 0 25 0 5 0 653691031 1304838144 273536 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 318564 273536 180 55 0 316450 0
[pid=4252/tid=4259] ppid=4250 vsize=1274256 CPUtime=934.96 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 394131 1260 0 0 93437 59 0 0 25 0 5 0 653691767 1304838144 273536 33554432000 4194304 4417452 140736535006368 18446744073709551615 4250612 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1274256 CPUtime=934.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 314747 1260 0 0 93440 47 0 0 25 0 5 0 653691767 1304838144 273536 33554432000 4194304 4417452 140736535006368 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1274256 CPUtime=927.55 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 376317 1260 0 0 92698 57 0 0 25 0 5 0 653691767 1304838144 273536 33554432000 4194304 4417452 140736535006368 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1274256 CPUtime=932.72 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 102532 1260 0 0 93258 14 0 0 25 0 5 0 653691767 1304838144 273536 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3737.48
Current children cumulated vsize (KiB) 1274256

[startup+1002.3 s]
/proc/loadavg: 8.15 8.04 7.54 9/304 4301
/proc/meminfo: memFree=10827724/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1276060 CPUtime=3976.93 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1383661 1260 0 0 397483 210 0 0 25 0 5 0 653691031 1306685440 273955 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 319015 273955 180 55 0 316901 0
[pid=4252/tid=4259] ppid=4250 vsize=1276060 CPUtime=994.96 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 394131 1260 0 0 99437 59 0 0 25 0 5 0 653691767 1306685440 273955 33554432000 4194304 4417452 140736535006368 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1276060 CPUtime=994.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 319655 1260 0 0 99439 48 0 0 25 0 5 0 653691767 1306685440 273955 33554432000 4194304 4417452 140736535006368 18446744073709551615 4355860 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1276060 CPUtime=987.55 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 380381 1260 0 0 98698 57 0 0 25 0 5 0 653691767 1306685440 273955 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1276060 CPUtime=992.17 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 109387 1260 0 0 99202 15 0 0 25 0 5 0 653691767 1306685440 273955 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3976.93
Current children cumulated vsize (KiB) 1276060

[startup+1062.3 s]
/proc/loadavg: 8.11 8.04 7.57 9/304 4303
/proc/meminfo: memFree=10780920/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1297200 CPUtime=4216.37 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1405023 1260 0 0 421424 213 0 0 25 0 5 0 653691031 1328332800 279240 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 324300 279240 180 55 0 322186 0
[pid=4252/tid=4259] ppid=4250 vsize=1297200 CPUtime=1054.96 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 394131 1260 0 0 105437 59 0 0 25 0 5 0 653691767 1328332800 279240 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1297200 CPUtime=1054.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 324768 1260 0 0 105438 49 0 0 25 0 5 0 653691767 1328332800 279240 33554432000 4194304 4417452 140736535006368 18446744073709551615 4353607 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1297200 CPUtime=1047.56 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 382397 1260 0 0 104698 58 0 0 25 0 5 0 653691767 1328332800 279240 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1297200 CPUtime=1051.61 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 123620 1260 0 0 105144 17 0 0 25 0 5 0 653691767 1328332800 279240 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4216.37
Current children cumulated vsize (KiB) 1297200

[startup+1122.3 s]
/proc/loadavg: 6.97 7.79 7.51 5/294 4322
/proc/meminfo: memFree=11716992/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1280792 CPUtime=4455.83 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1419856 1260 0 0 445368 215 0 0 25 0 5 0 653691031 1311531008 275138 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 320198 275138 180 55 0 318084 0
[pid=4252/tid=4259] ppid=4250 vsize=1280792 CPUtime=1114.97 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 394131 1260 0 0 111438 59 0 0 25 0 5 0 653691767 1311531008 275138 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1280792 CPUtime=1114.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 328014 1260 0 0 111438 49 0 0 25 0 5 0 653691767 1311531008 275138 33554432000 4194304 4417452 140736535006368 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1280792 CPUtime=1107.56 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 382397 1260 0 0 110698 58 0 0 25 0 5 0 653691767 1311531008 275138 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1280792 CPUtime=1111.05 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 135207 1260 0 0 111087 18 0 0 25 0 5 0 653691767 1311531008 275138 33554432000 4194304 4417452 140736535006368 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4455.83
Current children cumulated vsize (KiB) 1280792

[startup+1182.3 s]
/proc/loadavg: 5.14 7.11 7.29 5/294 4324
/proc/meminfo: memFree=11731112/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1257304 CPUtime=4695.28 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1571246 1260 0 0 469289 239 0 0 25 0 5 0 653691031 1287479296 271690 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 314326 271690 180 55 0 312212 0
[pid=4252/tid=4259] ppid=4250 vsize=1257304 CPUtime=1174.97 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 443470 1260 0 0 117430 67 0 0 25 0 5 0 653691767 1287479296 271690 33554432000 4194304 4417452 140736535006368 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1257304 CPUtime=1174.87 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 380047 1260 0 0 117428 59 0 0 25 0 5 0 653691767 1287479296 271690 33554432000 4194304 4417452 140736535006368 18446744073709551615 4365965 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1257304 CPUtime=1167.55 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 417772 1260 0 0 116693 62 0 0 25 0 5 0 653691767 1287479296 271690 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1257304 CPUtime=1170.5 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 149850 1260 0 0 117030 20 0 0 25 0 5 0 653691767 1287479296 271690 33554432000 4194304 4417452 140736535006368 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4695.28
Current children cumulated vsize (KiB) 1257304



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1208.6 s]
/proc/loadavg: 4.69 6.81 7.19 5/294 4324
/proc/meminfo: memFree=11711512/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1284936 CPUtime=4800.27 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1580010 1260 0 0 479786 241 0 0 25 0 5 0 653691031 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 321234 276174 180 55 0 319120 0
[pid=4252/tid=4259] ppid=4250 vsize=1284936 CPUtime=1201.28 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 443470 1260 0 0 120061 67 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1284936 CPUtime=1201.18 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 381023 1260 0 0 120059 59 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1284936 CPUtime=1193.86 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 417772 1260 0 0 119324 62 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1284936 CPUtime=1196.56 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 157638 1260 0 0 119635 21 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 1284936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1208.6 s]
/proc/loadavg: 4.69 6.81 7.19 5/294 4324
/proc/meminfo: memFree=11711512/32950928 swapFree=67083212/67111528
[pid=4252] ppid=4250 vsize=1284936 CPUtime=4800.27 cores=1,3,5,7
/proc/4252/stat : 4252 (plingeling) S 4250 4252 3297 0 -1 4202496 1580010 1260 0 0 479786 241 0 0 25 0 5 0 653691031 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4252/statm: 321234 276174 180 55 0 319120 0
[pid=4252/tid=4259] ppid=4250 vsize=1284936 CPUtime=1201.28 cores=1,3,5,7
/proc/4252/task/4259/stat : 4259 (plingeling) R 4250 4252 3297 0 -1 4202560 443470 1260 0 0 120061 67 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4281683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4252/tid=4260] ppid=4250 vsize=1284936 CPUtime=1201.18 cores=1,3,5,7
/proc/4252/task/4260/stat : 4260 (plingeling) R 4250 4252 3297 0 -1 4202560 381023 1260 0 0 120059 59 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4252/tid=4261] ppid=4250 vsize=1284936 CPUtime=1193.86 cores=1,3,5,7
/proc/4252/task/4261/stat : 4261 (plingeling) R 4250 4252 3297 0 -1 4202560 417772 1260 0 0 119324 62 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4252/tid=4262] ppid=4250 vsize=1284936 CPUtime=1196.56 cores=1,3,5,7
/proc/4252/task/4262/stat : 4262 (plingeling) R 4250 4252 3297 0 -1 4202560 157638 1260 0 0 119635 21 0 0 25 0 5 0 653691767 1315774464 276174 33554432000 4194304 4417452 140736535006368 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 1284936

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1208.66
CPU time (s): 4800.36
CPU user time (s): 4797.9
CPU system time (s): 2.46163
CPU usage (%): 397.163
Max. virtual memory (cumulated for all children) (KiB): 1432476

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.9
system time used= 2.46162
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1581270
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 308
involuntary context switches= 34769

runsolver used 3.13352 second user time and 8.18375 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-15 02:55:14
IDJOB=3371416
IDBENCH=82371
IDSOLVER=1848
FILE ID=node127/3371416-1305420909
RUNJOBID= node127-1305420624-3856
PBS_JOBID= 13324545
Free space on /tmp= 73280 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/blocks-blocks-36-0.120-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371416-1305420909/watcher-3371416-1305420909 -o /tmp/evaluation-result-3371416-1305420909/solver-3371416-1305420909 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371416-1305420909.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d94c04f870c828c80bd9a45ae3dedff
RANDOM SEED=422573399

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12432464 kB
Buffers:        294044 kB
Cached:        3708076 kB
SwapCached:       1620 kB
Active:       17373136 kB
Inactive:      2805032 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12432464 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:          182172 kB
Writeback:           0 kB
AnonPages:    16174296 kB
Mapped:          26600 kB
Slab:           230640 kB
PageTables:      47512 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44722796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73324 MiB
End job on node127 at 2011-05-15 03:15:24