Trace number 3371431

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.34 1204.15

General information on the benchmark

Nameindustrial/anbulagan/
hard-unsat/partial-5-11-u.cnf
MD5SUM8e22d84b1ae625d44fbf300a32374a2d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables164158
Number of clauses730719
Sum of the clauses size1660140
Maximum clause length10
Minimum clause length1
Number of clauses of size 112474
Number of clauses of size 2600009
Number of clauses of size 387256
Number of clauses of size 43440
Number of clauses of size 513760
Number of clauses of size over 513780

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371431-1305415515/watcher-3371431-1305415515 -o /tmp/evaluation-result-3371431-1305415515/solver-3371431-1305415515 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371431-1305415515.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.44 6.26 7.36 2/350 22362
/proc/meminfo: memFree=24094908/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=13376 CPUtime=0 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) R 22360 22362 22319 0 -1 4202496 1428 1252 0 0 0 0 0 0 24 0 1 0 653148242 13697024 1359 33554432000 4194304 4417452 140735440927360 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22362/statm: 3344 1359 148 55 0 1230 0

[startup+0.101463 s]
/proc/loadavg: 3.44 6.26 7.36 2/350 22362
/proc/meminfo: memFree=24094908/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=34524 CPUtime=0.09 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) R 22360 22362 22319 0 -1 4202496 6723 1252 0 0 8 1 0 0 24 0 1 0 653148242 35352576 6654 33554432000 4194304 4417452 140735440927360 18446744073709551615 4264888 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22362/statm: 8631 6654 148 55 0 6517 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34524

[startup+0.200438 s]
/proc/loadavg: 3.44 6.26 7.36 2/350 22362
/proc/meminfo: memFree=24094908/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=65504 CPUtime=0.19 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) R 22360 22362 22319 0 -1 4202496 14468 1252 0 0 17 2 0 0 25 0 1 0 653148242 67076096 14399 33554432000 4194304 4417452 140735440927360 18446744073709551615 4264885 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22362/statm: 16376 14399 148 55 0 14262 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 65504

[startup+0.300416 s]
/proc/loadavg: 3.44 6.26 7.36 2/350 22362
/proc/meminfo: memFree=24094908/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=73696 CPUtime=0.29 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) R 22360 22362 22319 0 -1 4202496 16516 1252 0 0 27 2 0 0 25 0 1 0 653148242 75464704 16447 33554432000 4194304 4417452 140735440927360 18446744073709551615 4262125 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22362/statm: 18424 16447 148 55 0 16310 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 73696

[startup+0.700345 s]
/proc/loadavg: 3.44 6.26 7.36 2/350 22362
/proc/meminfo: memFree=24094908/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=122580 CPUtime=0.69 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) R 22360 22362 22319 0 -1 4202496 28841 1252 0 0 65 4 0 0 25 0 1 0 653148242 125521920 28669 33554432000 4194304 4417452 140735440927360 18446744073709551615 4259993 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22362/statm: 30645 28669 149 55 0 28531 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 122580

[startup+1.50106 s]
/proc/loadavg: 3.44 6.26 7.36 9/359 22376
/proc/meminfo: memFree=23854524/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=234620 CPUtime=3.04 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 58720 1252 0 0 295 9 0 0 25 0 5 0 653148242 240250880 37004 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 58655 37004 175 55 0 56541 0
[pid=22362/tid=22373] ppid=22360 vsize=234620 CPUtime=0.52 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 6317 1252 0 0 51 1 0 0 18 0 5 0 653148339 240250880 37004 33554432000 4194304 4417452 140735440927360 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=234620 CPUtime=0.5 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 7253 1252 0 0 49 1 0 0 18 0 5 0 653148339 240250880 37004 33554432000 4194304 4417452 140735440927360 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=234620 CPUtime=0.51 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 5090 1252 0 0 51 0 0 0 18 0 5 0 653148339 240250880 37004 33554432000 4194304 4417452 140735440927360 18446744073709551615 4287398 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=234620 CPUtime=0.51 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 2868 1252 0 0 51 0 0 0 18 0 5 0 653148339 240250880 37004 33554432000 4194304 4417452 140735440927360 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.04
Current children cumulated vsize (KiB) 234620

[startup+3.10075 s]
/proc/loadavg: 3.44 6.26 7.36 9/359 22376
/proc/meminfo: memFree=23846964/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=240436 CPUtime=9.42 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 65767 1252 0 0 932 10 0 0 25 0 5 0 653148242 246206464 33515 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 60109 33515 177 55 0 57995 0
[pid=22362/tid=22373] ppid=22360 vsize=240436 CPUtime=2.11 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 8267 1252 0 0 210 1 0 0 21 0 5 0 653148339 246206464 33515 33554432000 4194304 4417452 140735440927360 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=240436 CPUtime=2.08 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 11804 1252 0 0 207 1 0 0 21 0 5 0 653148339 246206464 33515 33554432000 4194304 4417452 140735440927360 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=240436 CPUtime=2.11 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 5636 1252 0 0 211 0 0 0 21 0 5 0 653148339 246206464 33515 33554432000 4194304 4417452 140735440927360 18446744073709551615 4210748 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=240436 CPUtime=2.11 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 2868 1252 0 0 211 0 0 0 21 0 5 0 653148339 246206464 33515 33554432000 4194304 4417452 140735440927360 18446744073709551615 4239008 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.42
Current children cumulated vsize (KiB) 240436

[startup+6.3011 s]
/proc/loadavg: 3.81 6.29 7.36 9/359 22376
/proc/meminfo: memFree=23877320/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=241312 CPUtime=22.18 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 74356 1252 0 0 2207 11 0 0 25 0 5 0 653148242 247103488 35509 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 60328 35509 180 55 0 58214 0
[pid=22362/tid=22373] ppid=22360 vsize=241312 CPUtime=5.31 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 13310 1252 0 0 530 1 0 0 25 0 5 0 653148339 247103488 35509 33554432000 4194304 4417452 140735440927360 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=241312 CPUtime=5.25 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 14226 1252 0 0 523 2 0 0 25 0 5 0 653148339 247103488 35509 33554432000 4194304 4417452 140735440927360 18446744073709551615 4249216 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=241312 CPUtime=5.32 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 6760 1252 0 0 531 1 0 0 25 0 5 0 653148339 247103488 35509 33554432000 4194304 4417452 140735440927360 18446744073709551615 4354244 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=241312 CPUtime=5.3 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 2868 1252 0 0 530 0 0 0 25 0 5 0 653148339 247103488 35509 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364453 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.18
Current children cumulated vsize (KiB) 241312

[startup+12.7008 s]
/proc/loadavg: 4.14 6.32 7.36 9/359 22376
/proc/meminfo: memFree=23900304/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=244644 CPUtime=47.7 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 75492 1252 0 0 4759 11 0 0 25 0 5 0 653148242 250515456 36559 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 61161 36559 180 55 0 59047 0
[pid=22362/tid=22373] ppid=22360 vsize=244644 CPUtime=11.71 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 13437 1252 0 0 1170 1 0 0 25 0 5 0 653148339 250515456 36559 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=244644 CPUtime=11.58 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 14226 1252 0 0 1156 2 0 0 25 0 5 0 653148339 250515456 36559 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=244644 CPUtime=11.71 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 6867 1252 0 0 1170 1 0 0 25 0 5 0 653148339 250515456 36559 33554432000 4194304 4417452 140735440927360 18446744073709551615 4365118 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=244644 CPUtime=11.7 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 3770 1252 0 0 1170 0 0 0 25 0 5 0 653148339 250515456 36559 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 47.7
Current children cumulated vsize (KiB) 244644

[startup+25.5013 s]
/proc/loadavg: 5.06 6.41 7.38 9/359 22376
/proc/meminfo: memFree=23873580/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=242740 CPUtime=98.77 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 86882 1252 0 0 9864 13 0 0 25 0 5 0 653148242 248565760 37124 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 60685 37124 180 55 0 58571 0
[pid=22362/tid=22373] ppid=22360 vsize=242740 CPUtime=24.52 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 17339 1252 0 0 2450 2 0 0 25 0 5 0 653148339 248565760 37124 33554432000 4194304 4417452 140735440927360 18446744073709551615 4234287 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=242740 CPUtime=24.23 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 19726 1252 0 0 2421 2 0 0 25 0 5 0 653148339 248565760 37124 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=242740 CPUtime=24.51 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 8225 1252 0 0 2450 1 0 0 25 0 5 0 653148339 248565760 37124 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364500 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=242740 CPUtime=24.51 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 4400 1252 0 0 2450 1 0 0 25 0 5 0 653148339 248565760 37124 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 98.77
Current children cumulated vsize (KiB) 242740

[startup+51.1012 s]
/proc/loadavg: 6.06 6.54 7.39 9/359 22377
/proc/meminfo: memFree=23824004/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=272036 CPUtime=200.89 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 103524 1252 0 0 20074 15 0 0 25 0 5 0 653148242 278564864 45269 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 68009 45269 180 55 0 65895 0
[pid=22362/tid=22373] ppid=22360 vsize=272036 CPUtime=50.11 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 21083 1252 0 0 5009 2 0 0 25 0 5 0 653148339 278564864 45269 33554432000 4194304 4417452 140735440927360 18446744073709551615 4353543 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=272036 CPUtime=49.56 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 28123 1252 0 0 4953 3 0 0 25 0 5 0 653148339 278564864 45269 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=272036 CPUtime=50.1 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 10988 1252 0 0 5009 1 0 0 25 0 5 0 653148339 278564864 45269 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=272036 CPUtime=50.11 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 6138 1252 0 0 5010 1 0 0 25 0 5 0 653148339 278564864 45269 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 200.89
Current children cumulated vsize (KiB) 272036

[startup+102.301 s]
/proc/loadavg: 7.21 6.78 7.43 9/359 22378
/proc/meminfo: memFree=23765452/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=294844 CPUtime=405.16 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 142119 1252 0 0 40496 20 0 0 25 0 5 0 653148242 301920256 55045 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 73711 55045 180 55 0 71597 0
[pid=22362/tid=22373] ppid=22360 vsize=294844 CPUtime=101.32 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 26662 1252 0 0 10129 3 0 0 25 0 5 0 653148339 301920256 55045 33554432000 4194304 4417452 140735440927360 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=294844 CPUtime=100.21 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 46603 1252 0 0 10015 6 0 0 25 0 5 0 653148339 301920256 55045 33554432000 4194304 4417452 140735440927360 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=294844 CPUtime=101.3 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 17999 1252 0 0 10128 2 0 0 25 0 5 0 653148339 301920256 55045 33554432000 4194304 4417452 140735440927360 18446744073709551615 4265526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=294844 CPUtime=101.32 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 13663 1252 0 0 10130 2 0 0 25 0 5 0 653148339 301920256 55045 33554432000 4194304 4417452 140735440927360 18446744073709551615 4357003 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 405.16
Current children cumulated vsize (KiB) 294844

[startup+162.301 s]
/proc/loadavg: 7.80 7.03 7.47 9/359 22380
/proc/meminfo: memFree=23727968/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=316004 CPUtime=644.47 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 183318 1252 0 0 64422 25 0 0 25 0 5 0 653148242 323588096 60583 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 79001 60583 180 55 0 76887 0
[pid=22362/tid=22373] ppid=22360 vsize=316004 CPUtime=161.32 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 33190 1252 0 0 16128 4 0 0 25 0 5 0 653148339 323588096 60583 33554432000 4194304 4417452 140735440927360 18446744073709551615 4308243 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=316004 CPUtime=159.55 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 68347 1252 0 0 15947 8 0 0 25 0 5 0 653148339 323588096 60583 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=316004 CPUtime=161.28 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 24125 1252 0 0 16125 3 0 0 25 0 5 0 653148339 323588096 60583 33554432000 4194304 4417452 140735440927360 18446744073709551615 4357970 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=316004 CPUtime=161.31 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 20464 1252 0 0 16128 3 0 0 25 0 5 0 653148339 323588096 60583 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 644.47
Current children cumulated vsize (KiB) 316004


################
# More data... #
################

[pid=22362/tid=22374] ppid=22360 vsize=583056 CPUtime=693.68 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 296571 1252 0 0 69329 39 0 0 25 0 5 0 653148339 597049344 132363 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=583056 CPUtime=701.18 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 58357 1252 0 0 70110 8 0 0 25 0 5 0 653148339 597049344 132363 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=583056 CPUtime=701.34 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 123940 1252 0 0 70118 16 0 0 25 0 5 0 653148339 597049344 132363 33554432000 4194304 4417452 140735440927360 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2798.54
Current children cumulated vsize (KiB) 583056

[startup+762.301 s]
/proc/loadavg: 8.14 7.97 7.77 9/359 22396
/proc/meminfo: memFree=23342656/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=628996 CPUtime=3037.93 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 687588 1252 0 0 303699 94 0 0 25 0 5 0 653148242 644091904 139904 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 157249 139904 180 55 0 155135 0
[pid=22362/tid=22373] ppid=22360 vsize=628996 CPUtime=761.35 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 127436 1252 0 0 76119 16 0 0 25 0 5 0 653148339 644091904 139904 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=628996 CPUtime=753.03 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 306115 1252 0 0 75263 40 0 0 25 0 5 0 653148339 644091904 139904 33554432000 4194304 4417452 140735440927360 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=628996 CPUtime=761.19 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 64408 1252 0 0 76110 9 0 0 25 0 5 0 653148339 644091904 139904 33554432000 4194304 4417452 140735440927360 18446744073709551615 4277027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=628996 CPUtime=761.35 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 152437 1252 0 0 76115 20 0 0 25 0 5 0 653148339 644091904 139904 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3037.93
Current children cumulated vsize (KiB) 628996

[startup+822.301 s]
/proc/loadavg: 8.16 8.00 7.79 9/359 22398
/proc/meminfo: memFree=23354292/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=598044 CPUtime=3277.23 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 741943 1252 0 0 327621 102 0 0 25 0 5 0 653148242 612397056 130412 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 149511 130412 180 55 0 147397 0
[pid=22362/tid=22373] ppid=22360 vsize=598044 CPUtime=821.34 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 134409 1252 0 0 82117 17 0 0 25 0 5 0 653148339 612397056 130412 33554432000 4194304 4417452 140735440927360 18446744073709551615 4281860 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=598044 CPUtime=812.37 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 313212 1252 0 0 81195 42 0 0 25 0 5 0 653148339 612397056 130412 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=598044 CPUtime=821.16 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 72600 1252 0 0 82106 10 0 0 25 0 5 0 653148339 612397056 130412 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=598044 CPUtime=821.35 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 184530 1252 0 0 82110 25 0 0 25 0 5 0 653148339 612397056 130412 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3277.23
Current children cumulated vsize (KiB) 598044

[startup+882.314 s]
/proc/loadavg: 8.15 8.03 7.81 9/359 22399
/proc/meminfo: memFree=23361664/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=649108 CPUtime=3516.62 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 782287 1252 0 0 351555 107 0 0 25 0 5 0 653148242 664686592 136178 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 162277 136178 180 55 0 160163 0
[pid=22362/tid=22373] ppid=22360 vsize=649108 CPUtime=881.36 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 138556 1252 0 0 88118 18 0 0 25 0 5 0 653148339 664686592 136178 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=649108 CPUtime=871.72 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 329768 1252 0 0 87128 44 0 0 25 0 5 0 653148339 664686592 136178 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236634 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=649108 CPUtime=881.17 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 74167 1252 0 0 88106 11 0 0 25 0 5 0 653148339 664686592 136178 33554432000 4194304 4417452 140735440927360 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=649108 CPUtime=881.36 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 202604 1252 0 0 88109 27 0 0 25 0 5 0 653148339 664686592 136178 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3516.62
Current children cumulated vsize (KiB) 649108

[startup+942.301 s]
/proc/loadavg: 8.14 8.05 7.83 9/359 22401
/proc/meminfo: memFree=23311152/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=647884 CPUtime=3755.92 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 837674 1252 0 0 375478 114 0 0 25 0 5 0 653148242 663433216 135288 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 161971 135288 180 55 0 159857 0
[pid=22362/tid=22373] ppid=22360 vsize=647884 CPUtime=941.34 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 139531 1252 0 0 94116 18 0 0 25 0 5 0 653148339 663433216 135288 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=647884 CPUtime=931.07 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 360592 1252 0 0 93059 48 0 0 25 0 5 0 653148339 663433216 135288 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=647884 CPUtime=941.15 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 74167 1252 0 0 94104 11 0 0 25 0 5 0 653148339 663433216 135288 33554432000 4194304 4417452 140735440927360 18446744073709551615 4330529 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=647884 CPUtime=941.35 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 226192 1252 0 0 94105 30 0 0 25 0 5 0 653148339 663433216 135288 33554432000 4194304 4417452 140735440927360 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3755.92
Current children cumulated vsize (KiB) 647884

[startup+1002.3 s]
/proc/loadavg: 8.13 8.07 7.85 9/359 22402
/proc/meminfo: memFree=23323520/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=568988 CPUtime=3995.25 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 896573 1252 0 0 399402 123 0 0 25 0 5 0 653148242 582643712 129596 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 142247 129596 180 55 0 140133 0
[pid=22362/tid=22373] ppid=22360 vsize=568988 CPUtime=1001.35 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 144202 1252 0 0 100116 19 0 0 25 0 5 0 653148339 582643712 129596 33554432000 4194304 4417452 140735440927360 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=568988 CPUtime=990.41 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 402448 1252 0 0 98987 54 0 0 25 0 5 0 653148339 582643712 129596 33554432000 4194304 4417452 140735440927360 18446744073709551615 4302940 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=568988 CPUtime=1001.13 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 78332 1252 0 0 100102 11 0 0 25 0 5 0 653148339 582643712 129596 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=568988 CPUtime=1001.35 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 234399 1252 0 0 100104 31 0 0 25 0 5 0 653148339 582643712 129596 33554432000 4194304 4417452 140735440927360 18446744073709551615 4320983 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3995.25
Current children cumulated vsize (KiB) 568988

[startup+1062.3 s]
/proc/loadavg: 8.12 8.08 7.86 9/359 22404
/proc/meminfo: memFree=23303644/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=612520 CPUtime=4234.59 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 949521 1252 0 0 423331 128 0 0 25 0 5 0 653148242 627220480 138740 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 153130 138740 180 55 0 151016 0
[pid=22362/tid=22373] ppid=22360 vsize=612520 CPUtime=1061.36 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 149289 1252 0 0 106116 20 0 0 25 0 5 0 653148339 627220480 138740 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=612520 CPUtime=1049.76 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 436985 1252 0 0 104918 58 0 0 25 0 5 0 653148339 627220480 138740 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=612520 CPUtime=1061.12 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 78345 1252 0 0 106101 11 0 0 25 0 5 0 653148339 627220480 138740 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=612520 CPUtime=1061.36 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 247710 1252 0 0 106103 33 0 0 25 0 5 0 653148339 627220480 138740 33554432000 4194304 4417452 140735440927360 18446744073709551615 4353714 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4234.59
Current children cumulated vsize (KiB) 612520

[startup+1122.3 s]
/proc/loadavg: 8.08 8.08 7.87 9/359 22406
/proc/meminfo: memFree=23300872/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=653992 CPUtime=4473.94 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 976016 1252 0 0 447262 132 0 0 25 0 5 0 653148242 669687808 142978 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 163498 142978 180 55 0 161384 0
[pid=22362/tid=22373] ppid=22360 vsize=653992 CPUtime=1121.36 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 150114 1252 0 0 112116 20 0 0 25 0 5 0 653148339 669687808 142978 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=653992 CPUtime=1109.1 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 443829 1252 0 0 110852 58 0 0 25 0 5 0 653148339 669687808 142978 33554432000 4194304 4417452 140735440927360 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=653992 CPUtime=1121.11 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 78345 1252 0 0 112100 11 0 0 25 0 5 0 653148339 669687808 142978 33554432000 4194304 4417452 140735440927360 18446744073709551615 4309575 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=653992 CPUtime=1121.36 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 266536 1252 0 0 112101 35 0 0 25 0 5 0 653148339 669687808 142978 33554432000 4194304 4417452 140735440927360 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4473.94
Current children cumulated vsize (KiB) 653992

[startup+1182.3 s]
/proc/loadavg: 8.11 8.08 7.88 9/359 22407
/proc/meminfo: memFree=23349800/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=643056 CPUtime=4713.29 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 1004407 1252 0 0 471193 136 0 0 25 0 5 0 653148242 658489344 134644 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 160764 134644 180 55 0 158650 0
[pid=22362/tid=22373] ppid=22360 vsize=643056 CPUtime=1181.36 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 155927 1252 0 0 118115 21 0 0 25 0 5 0 653148339 658489344 134644 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=643056 CPUtime=1168.45 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 465063 1252 0 0 116784 61 0 0 25 0 5 0 653148339 658489344 134644 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=643056 CPUtime=1181.11 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 78426 1252 0 0 118099 12 0 0 25 0 5 0 653148339 658489344 134644 33554432000 4194304 4417452 140735440927360 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=643056 CPUtime=1181.36 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 267799 1252 0 0 118101 35 0 0 25 0 5 0 653148339 658489344 134644 33554432000 4194304 4417452 140735440927360 18446744073709551615 4281649 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4713.29
Current children cumulated vsize (KiB) 643056



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.1 s]
/proc/loadavg: 8.07 8.07 7.89 5/353 22409
/proc/meminfo: memFree=23486356/32950928 swapFree=45937192/67111528
[pid=22362] ppid=22360 vsize=720920 CPUtime=4800.27 cores=0,2,4,6
/proc/22362/stat : 22362 (plingeling) S 22360 22362 22319 0 -1 4202496 1025585 1252 0 0 479889 138 0 0 25 0 5 0 653148242 738222080 155822 33554432000 4194304 4417452 140735440927360 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22362/statm: 180230 155822 180 55 0 178116 0
[pid=22362/tid=22373] ppid=22360 vsize=720920 CPUtime=1203.18 cores=0,2,4,6
/proc/22362/task/22373/stat : 22373 (plingeling) R 22360 22362 22319 0 -1 4202560 155927 1252 0 0 120297 21 0 0 25 0 5 0 653148339 738222080 155822 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236630 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22362/tid=22374] ppid=22360 vsize=720920 CPUtime=1190.01 cores=0,2,4,6
/proc/22362/task/22374/stat : 22374 (plingeling) R 22360 22362 22319 0 -1 4202560 470871 1252 0 0 118940 61 0 0 25 0 5 0 653148339 738222080 155822 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22362/tid=22375] ppid=22360 vsize=720920 CPUtime=1202.92 cores=0,2,4,6
/proc/22362/task/22375/stat : 22375 (plingeling) R 22360 22362 22319 0 -1 4202560 82522 1252 0 0 120280 12 0 0 25 0 5 0 653148339 738222080 155822 33554432000 4194304 4417452 140735440927360 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22362/tid=22376] ppid=22360 vsize=720920 CPUtime=1203.18 cores=0,2,4,6
/proc/22362/task/22376/stat : 22376 (plingeling) R 22360 22362 22319 0 -1 4202560 279073 1252 0 0 120280 38 0 0 25 0 5 0 653148339 738222080 155822 33554432000 4194304 4417452 140735440927360 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 720920

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.15
CPU time (s): 4800.34
CPU user time (s): 4798.93
CPU system time (s): 1.41678
CPU usage (%): 398.651
Max. virtual memory (cumulated for all children) (KiB): 759916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.93
system time used= 1.41678
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1026837
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 163
involuntary context switches= 36096

runsolver used 3.76943 second user time and 9.40157 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 01:25:16
IDJOB=3371431
IDBENCH=20386
IDSOLVER=1848
FILE ID=node149/3371431-1305415515
RUNJOBID= node149-1305415515-22337
PBS_JOBID= 13324565
Free space on /tmp= 73548 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT07/industrial/anbulagan/hard-unsat/partial-5-11-u.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371431-1305415515/watcher-3371431-1305415515 -o /tmp/evaluation-result-3371431-1305415515/solver-3371431-1305415515 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371431-1305415515.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e22d84b1ae625d44fbf300a32374a2d
RANDOM SEED=1521510749

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      24095312 kB
Buffers:        312396 kB
Cached:        3891908 kB
SwapCached:      19984 kB
Active:        6348284 kB
Inactive:      2210492 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      24095312 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:           23440 kB
Writeback:          16 kB
AnonPages:     4346860 kB
Mapped:          13316 kB
Slab:           158196 kB
PageTables:      71872 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80225396 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73560 MiB
End job on node149 at 2011-05-15 01:45:22