Trace number 3309591

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.6 5019.25

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUM6c2d25eda70423643946d76935ceb950
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1512832
Number of clauses8233086
Sum of the clauses size19530286
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 28165680
Number of clauses of size 31280
Number of clauses of size 41600
Number of clauses of size 51600
Number of clauses of size over 562080

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309591-1304007348/watcher-3309591-1304007348 -o /tmp/evaluation-result-3309591-1304007348/solver-3309591-1304007348 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309591-1304007348.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.93 7.78 7.92 1/170 10853
/proc/meminfo: memFree=30375020/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=14640 CPUtime=0 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 1583 1253 0 0 0 0 0 0 21 0 1 0 512335671 14991360 1512 33554432000 4194304 4417332 140733830295152 18446744073709551615 253640553565 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 3660 1526 138 55 0 1546 0

[startup+0.00840296 s]
/proc/loadavg: 6.93 7.78 7.92 1/170 10853
/proc/meminfo: memFree=30375020/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=20552 CPUtime=0 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 2887 1253 0 0 0 0 0 0 21 0 1 0 512335671 21045248 2817 33554432000 4194304 4417332 140733830295152 18446744073709551615 253640553565 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 5138 2835 138 55 0 3024 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 20552

[startup+0.100387 s]
/proc/loadavg: 6.93 7.78 7.92 1/170 10853
/proc/meminfo: memFree=30375020/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=44956 CPUtime=0.09 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 9333 1253 0 0 8 1 0 0 21 0 1 0 512335671 46034944 9261 33554432000 4194304 4417332 140733830295152 18446744073709551615 4231377 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 11239 9261 147 55 0 9125 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 44956

[startup+0.30036 s]
/proc/loadavg: 6.93 7.78 7.92 1/170 10853
/proc/meminfo: memFree=30375020/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=79872 CPUtime=0.29 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 18063 1253 0 0 27 2 0 0 22 0 1 0 512335671 81788928 17991 33554432000 4194304 4417332 140733830295152 18446744073709551615 253640859392 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 19968 17991 148 55 0 17854 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 79872

[startup+0.700274 s]
/proc/loadavg: 6.93 7.78 7.92 1/170 10853
/proc/meminfo: memFree=30375020/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=117148 CPUtime=0.68 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 27382 1253 0 0 65 3 0 0 23 0 1 0 512335671 119959552 27310 33554432000 4194304 4417332 140733830295152 18446744073709551615 4262130 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 29287 27310 148 55 0 27173 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 117148

[startup+1.50114 s]
/proc/loadavg: 6.93 7.78 7.92 2/171 10859
/proc/meminfo: memFree=30176496/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=214452 CPUtime=1.49 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 51741 1253 0 0 142 7 0 0 25 0 1 0 512335671 219598848 51636 33554432000 4194304 4417332 140733830295152 18446744073709551615 4231512 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 53613 51636 148 55 0 51499 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 214452

[startup+3.10084 s]
/proc/loadavg: 6.93 7.78 7.92 2/171 10859
/proc/meminfo: memFree=29965084/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=486348 CPUtime=3.09 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 119812 1253 0 0 293 16 0 0 25 0 1 0 512335671 498020352 119610 33554432000 4194304 4417332 140733830295152 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 121587 119610 148 55 0 119473 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 486348

[startup+6.30025 s]
/proc/loadavg: 6.54 7.68 7.89 2/171 10859
/proc/meminfo: memFree=29441680/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=940884 CPUtime=6.29 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 233734 1253 0 0 600 29 0 0 25 0 1 0 512335671 963465216 233244 33554432000 4194304 4417332 140733830295152 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 235221 233244 148 55 0 233107 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 940884

[startup+12.7011 s]
/proc/loadavg: 6.09 7.57 7.86 2/171 10859
/proc/meminfo: memFree=28548116/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=1833812 CPUtime=12.69 cores=0-7
/proc/10853/stat : 10853 (plingeling) R 10851 10853 10627 0 -1 4202496 456966 1253 0 0 1211 58 0 0 25 0 1 0 512335671 1877823488 456476 33554432000 4194304 4417332 140733830295152 18446744073709551615 253640859392 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/10853/statm: 458453 456476 148 55 0 456339 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1833812

[startup+25.5007 s]
/proc/loadavg: 6.04 7.48 7.82 9/179 10867
/proc/meminfo: memFree=27889376/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=2863984 CPUtime=83.3 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 1199338 1253 0 0 8154 176 0 0 18 0 9 0 512335671 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 715996 673418 177 55 0 713882 0
[pid=10853/tid=10860] ppid=10851 vsize=2863984 CPUtime=8.26 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 58761 1253 0 0 817 9 0 0 25 0 9 0 512337391 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4234778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=2863984 CPUtime=8.24 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 60037 1253 0 0 814 10 0 0 25 0 9 0 512337391 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4234794 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=2863984 CPUtime=8.26 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 114357 1253 0 0 808 18 0 0 25 0 9 0 512337391 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=2863984 CPUtime=8.27 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 30495 1253 0 0 820 7 0 0 25 0 9 0 512337391 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232623 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=2863984 CPUtime=8.25 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 54414 1253 0 0 818 7 0 0 25 0 9 0 512337391 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4265465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=2863984 CPUtime=8.26 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 85324 1253 0 0 811 15 0 0 25 0 9 0 512337392 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4255681 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=2863984 CPUtime=8.26 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 97951 1253 0 0 813 13 0 0 25 0 9 0 512337392 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4259140 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=2863984 CPUtime=8.21 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 93562 1253 0 0 805 16 0 0 25 0 9 0 512337393 2932719616 673418 33554432000 4194304 4417332 140733830295152 18446744073709551615 4261313 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 83.3
Current children cumulated vsize (KiB) 2863984

[startup+51.1011 s]
/proc/loadavg: 6.71 7.52 7.82 9/179 10868
/proc/meminfo: memFree=27658516/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=2980844 CPUtime=287.52 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 1928780 1253 0 0 28456 296 0 0 18 0 9 0 512335671 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 745211 689151 180 55 0 743097 0
[pid=10853/tid=10860] ppid=10851 vsize=2980844 CPUtime=33.8 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 134955 1253 0 0 3354 26 0 0 25 0 9 0 512337391 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4252216 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=2980844 CPUtime=33.69 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 205994 1253 0 0 3337 32 0 0 25 0 9 0 512337391 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4253179 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=2980844 CPUtime=33.83 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 157777 1253 0 0 3355 28 0 0 25 0 9 0 512337391 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4254955 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=2980844 CPUtime=33.85 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 93348 1253 0 0 3372 13 0 0 25 0 9 0 512337391 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=2980844 CPUtime=33.82 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 176072 1253 0 0 3355 27 0 0 25 0 9 0 512337391 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4225814 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=2980844 CPUtime=33.81 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 150058 1253 0 0 3355 26 0 0 25 0 9 0 512337392 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4252361 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=2980844 CPUtime=33.76 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 194648 1253 0 0 3347 29 0 0 25 0 9 0 512337392 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4254990 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=2980844 CPUtime=33.69 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 211491 1253 0 0 3335 34 0 0 25 0 9 0 512337393 3052384256 689151 33554432000 4194304 4417332 140733830295152 18446744073709551615 4233530 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 287.52
Current children cumulated vsize (KiB) 2980844

[startup+102.307 s]
/proc/loadavg: 7.49 7.61 7.83 9/179 10869
/proc/meminfo: memFree=27626688/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=2971924 CPUtime=696.91 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 2091896 1253 0 0 69371 320 0 0 18 0 9 0 512335671 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 742981 686766 181 55 0 740867 0
[pid=10853/tid=10860] ppid=10851 vsize=2971924 CPUtime=85.01 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 141398 1253 0 0 8473 28 0 0 25 0 9 0 512337391 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=2971924 CPUtime=84.9 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 216534 1253 0 0 8456 34 0 0 25 0 9 0 512337391 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=2971924 CPUtime=85.03 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 176853 1253 0 0 8472 31 0 0 25 0 9 0 512337391 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=2971924 CPUtime=85.07 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 158362 1253 0 0 8486 21 0 0 25 0 9 0 512337391 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=2971924 CPUtime=85.03 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 189243 1253 0 0 8473 30 0 0 25 0 9 0 512337391 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=2971924 CPUtime=85.02 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 156501 1253 0 0 8475 27 0 0 25 0 9 0 512337392 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364362 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=2971924 CPUtime=84.96 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 223905 1253 0 0 8463 33 0 0 25 0 9 0 512337392 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232609 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=2971924 CPUtime=84.62 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 224663 1253 0 0 8426 36 0 0 25 0 9 0 512337393 3043250176 686766 33554432000 4194304 4417332 140733830295152 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 696.91
Current children cumulated vsize (KiB) 2971924

[startup+162.301 s]
/proc/loadavg: 7.81 7.68 7.84 9/179 10871
/proc/meminfo: memFree=27301948/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=3283636 CPUtime=1176.5 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 2286220 1253 0 0 117295 355 0 0 18 0 9 0 512335671 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 820909 767653 181 55 0 818795 0
[pid=10853/tid=10860] ppid=10851 vsize=3283636 CPUtime=145 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 154772 1253 0 0 14471 29 0 0 25 0 9 0 512337391 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=3283636 CPUtime=144.9 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 230318 1253 0 0 14455 35 0 0 25 0 9 0 512337391 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=3283636 CPUtime=145.01 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 253173 1253 0 0 14456 45 0 0 25 0 9 0 512337391 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4259035 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=3283636 CPUtime=145.06 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 172860 1253 0 0 14483 23 0 0 25 0 9 0 512337391 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=3283636 CPUtime=145.02 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 189243 1253 0 0 14472 30 0 0 25 0 9 0 512337391 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236928 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=3283636 CPUtime=145.01 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 166498 1253 0 0 14473 28 0 0 25 0 9 0 512337392 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=3283636 CPUtime=144.93 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 290256 1253 0 0 14445 48 0 0 25 0 9 0 512337392 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4234240 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=3283636 CPUtime=144.3 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 224663 1253 0 0 14393 37 0 0 25 0 9 0 512337393 3362443264 767653 33554432000 4194304 4417332 140733830295152 18446744073709551615 4235790 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1176.5
Current children cumulated vsize (KiB) 3283636


################
# More data... #
################

[pid=10853/tid=10862] ppid=10851 vsize=13451704 CPUtime=4704.6 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 2907738 1253 0 0 469796 664 0 0 25 0 9 0 512337391 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=13451704 CPUtime=4704.99 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 5541728 1253 0 0 469208 1291 0 0 25 0 9 0 512337391 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=13451704 CPUtime=4704.93 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2337084 1253 0 0 469987 506 0 0 25 0 9 0 512337391 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=13451704 CPUtime=4704.9 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 1960350 1253 0 0 470071 419 0 0 25 0 9 0 512337392 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=13451704 CPUtime=4704.94 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3238141 1253 0 0 469762 732 0 0 25 0 9 0 512337392 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=13451704 CPUtime=4691.21 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3092137 1253 0 0 468407 714 0 0 25 0 9 0 512337393 13774544896 3309651 33554432000 4194304 4417332 140733830295152 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37630.4
Current children cumulated vsize (KiB) 13451704

[startup+4782.3 s]
/proc/loadavg: 8.13 8.07 8.01 9/179 11006
/proc/meminfo: memFree=16154204/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=14408652 CPUtime=38110.1 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 24613922 1253 0 0 3805532 5475 0 0 18 0 9 0 512335671 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 3602163 3548888 181 55 0 3600049 0
[pid=10853/tid=10860] ppid=10851 vsize=14408652 CPUtime=4752.94 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 2491337 1253 0 0 474763 531 0 0 25 0 9 0 512337391 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4263047 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=14408652 CPUtime=4764.32 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 2266122 1253 0 0 475933 499 0 0 25 0 9 0 512337391 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4251076 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=14408652 CPUtime=4764.58 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 2929048 1253 0 0 475791 667 0 0 25 0 9 0 512337391 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=14408652 CPUtime=4764.99 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 5649218 1253 0 0 475180 1319 0 0 25 0 9 0 512337391 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=14408652 CPUtime=4764.93 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2337084 1253 0 0 475987 506 0 0 25 0 9 0 512337391 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=14408652 CPUtime=4764.9 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 1985360 1253 0 0 476067 423 0 0 25 0 9 0 512337392 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=14408652 CPUtime=4764.93 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3259179 1253 0 0 475758 735 0 0 25 0 9 0 512337392 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=14408652 CPUtime=4751.21 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3092137 1253 0 0 474407 714 0 0 25 0 9 0 512337393 14754459648 3548888 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38110.1
Current children cumulated vsize (KiB) 14408652

[startup+4842.3 s]
/proc/loadavg: 8.12 8.07 8.00 9/179 11007
/proc/meminfo: memFree=17009200/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=13555420 CPUtime=38589.8 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 25219025 1253 0 0 3853354 5621 0 0 18 0 9 0 512335671 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 3388855 3335580 181 55 0 3386741 0
[pid=10853/tid=10860] ppid=10851 vsize=13555420 CPUtime=4812.61 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 2491337 1253 0 0 480730 531 0 0 25 0 9 0 512337391 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=13555420 CPUtime=4824.32 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 2299045 1253 0 0 481928 504 0 0 25 0 9 0 512337391 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=13555420 CPUtime=4824.58 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 2950298 1253 0 0 481788 670 0 0 25 0 9 0 512337391 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4358027 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=13555420 CPUtime=4824.99 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 6170374 1253 0 0 481052 1447 0 0 25 0 9 0 512337391 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=13555420 CPUtime=4824.93 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2342412 1253 0 0 481980 513 0 0 25 0 9 0 512337391 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4281649 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=13555420 CPUtime=4824.9 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 1991582 1253 0 0 482066 424 0 0 25 0 9 0 512337392 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=13555420 CPUtime=4824.93 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3277403 1253 0 0 481755 738 0 0 25 0 9 0 512337392 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=13555420 CPUtime=4811.21 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3092137 1253 0 0 480407 714 0 0 25 0 9 0 512337393 13880750080 3335580 33554432000 4194304 4417332 140733830295152 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38589.8
Current children cumulated vsize (KiB) 13555420

[startup+4902.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/179 11009
/proc/meminfo: memFree=17288448/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=13275888 CPUtime=39069.4 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 25413460 1253 0 0 3901278 5665 0 0 18 0 9 0 512335671 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 3318972 3265697 181 55 0 3316858 0
[pid=10853/tid=10860] ppid=10851 vsize=13275888 CPUtime=4872.29 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 2536538 1253 0 0 486683 546 0 0 25 0 9 0 512337391 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=13275888 CPUtime=4884.32 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 2303973 1253 0 0 487927 505 0 0 25 0 9 0 512337391 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4366403 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=13275888 CPUtime=4884.58 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 3026141 1253 0 0 487776 682 0 0 25 0 9 0 512337391 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=13275888 CPUtime=4884.99 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 6170374 1253 0 0 487052 1447 0 0 25 0 9 0 512337391 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=13275888 CPUtime=4884.92 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2371230 1253 0 0 487974 518 0 0 25 0 9 0 512337391 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4236995 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=13275888 CPUtime=4884.9 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 2014734 1253 0 0 488063 427 0 0 25 0 9 0 512337392 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=13275888 CPUtime=4884.94 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3293896 1253 0 0 487752 742 0 0 25 0 9 0 512337392 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=13275888 CPUtime=4871.21 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3092137 1253 0 0 486404 717 0 0 25 0 9 0 512337393 13594509312 3265697 33554432000 4194304 4417332 140733830295152 18446744073709551615 4309982 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39069.4
Current children cumulated vsize (KiB) 13275888

[startup+4962.3 s]
/proc/loadavg: 8.10 8.07 8.00 9/179 11011
/proc/meminfo: memFree=16305244/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=14257276 CPUtime=39549.1 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 25785044 1253 0 0 3949187 5723 0 0 18 0 9 0 512335671 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 3564319 3511044 181 55 0 3562205 0
[pid=10853/tid=10860] ppid=10851 vsize=14257276 CPUtime=4931.96 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 2561347 1253 0 0 492642 554 0 0 25 0 9 0 512337391 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4232705 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=14257276 CPUtime=4944.32 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 2354358 1253 0 0 493920 512 0 0 25 0 9 0 512337391 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=14257276 CPUtime=4944.58 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 3026141 1253 0 0 493776 682 0 0 25 0 9 0 512337391 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364631 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=14257276 CPUtime=4945 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 6170374 1253 0 0 493053 1447 0 0 25 0 9 0 512337391 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=14257276 CPUtime=4944.93 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2389255 1253 0 0 493972 521 0 0 25 0 9 0 512337391 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=14257276 CPUtime=4944.9 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 2175132 1253 0 0 494040 450 0 0 25 0 9 0 512337392 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=14257276 CPUtime=4944.94 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3411863 1253 0 0 493734 760 0 0 25 0 9 0 512337392 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=14257276 CPUtime=4931.22 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3092137 1253 0 0 492404 718 0 0 25 0 9 0 512337393 14599450624 3511044 33554432000 4194304 4417332 140733830295152 18446744073709551615 4331716 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39549.1
Current children cumulated vsize (KiB) 14257276



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.7 s]
/proc/loadavg: 8.09 8.07 8.00 9/179 11012
/proc/meminfo: memFree=14652176/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=15907068 CPUtime=40000 cores=0-7
/proc/10853/stat : 10853 (plingeling) S 10851 10853 10627 0 -1 4202496 26257154 1253 0 0 3994156 5848 0 0 18 0 9 0 512335671 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 3976767 3923491 181 55 0 3974653 0
[pid=10853/tid=10860] ppid=10851 vsize=15907068 CPUtime=4988.06 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4202560 2661150 1253 0 0 498219 587 0 0 25 0 9 0 512337391 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4358064 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10853/tid=10861] ppid=10851 vsize=15907068 CPUtime=5000.73 cores=0-7
/proc/10853/task/10861/stat : 10861 (plingeling) R 10851 10853 10627 0 -1 4202560 2375371 1253 0 0 499557 516 0 0 25 0 9 0 512337391 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10853/tid=10862] ppid=10851 vsize=15907068 CPUtime=5000.98 cores=0-7
/proc/10853/task/10862/stat : 10862 (plingeling) R 10851 10853 10627 0 -1 4202560 3063180 1253 0 0 499407 691 0 0 25 0 9 0 512337391 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4306281 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10853/tid=10863] ppid=10851 vsize=15907068 CPUtime=5001.4 cores=0-7
/proc/10853/task/10863/stat : 10863 (plingeling) R 10851 10853 10627 0 -1 4202560 6170374 1253 0 0 498693 1447 0 0 25 0 9 0 512337391 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4358841 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10853/tid=10864] ppid=10851 vsize=15907068 CPUtime=5001.34 cores=0-7
/proc/10853/task/10864/stat : 10864 (plingeling) R 10851 10853 10627 0 -1 4202560 2406849 1253 0 0 499611 523 0 0 25 0 9 0 512337391 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4357456 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10853/tid=10865] ppid=10851 vsize=15907068 CPUtime=5001.31 cores=0-7
/proc/10853/task/10865/stat : 10865 (plingeling) R 10851 10853 10627 0 -1 4202560 2175132 1253 0 0 499681 450 0 0 25 0 9 0 512337392 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10853/tid=10866] ppid=10851 vsize=15907068 CPUtime=5001.34 cores=0-7
/proc/10853/task/10866/stat : 10866 (plingeling) R 10851 10853 10627 0 -1 4202560 3411863 1253 0 0 499374 760 0 0 25 0 9 0 512337392 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10853/tid=10867] ppid=10851 vsize=15907068 CPUtime=4987.62 cores=0-7
/proc/10853/task/10867/stat : 10867 (plingeling) R 10851 10853 10627 0 -1 4202560 3388798 1253 0 0 497967 795 0 0 25 0 9 0 512337393 16288837632 3923491 33554432000 4194304 4417332 140733830295152 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000
Current children cumulated vsize (KiB) 15907068

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5019 s]
/proc/loadavg: 8.09 8.07 8.00 9/179 11012
/proc/meminfo: memFree=14652176/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=0 CPUtime=40000.4 cores=0-7
/proc/10853/stat : 10853 (plingeling) Z 10851 10853 10627 0 -1 4203548 26257154 1253 0 0 3994161 5877 0 0 18 0 2 0 512335671 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 0 0 0 0 0 0 0
[pid=10853/tid=10860] ppid=10851 vsize=0 CPUtime=4988.36 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4203588 2661150 1253 0 0 498220 616 0 0 25 0 2 0 512337391 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

[startup+5019.2 s]
/proc/loadavg: 8.09 8.07 8.00 2/173 11013
/proc/meminfo: memFree=29101324/32951124 swapFree=67111364/67111528
[pid=10853] ppid=10851 vsize=0 CPUtime=40000.6 cores=0-7
/proc/10853/stat : 10853 (plingeling) Z 10851 10853 10627 0 -1 4203548 26257154 1253 0 0 3994161 5897 0 0 18 0 2 0 512335671 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/10853/statm: 0 0 0 0 0 0 0
[pid=10853/tid=10860] ppid=10851 vsize=0 CPUtime=4988.56 cores=0-7
/proc/10853/task/10860/stat : 10860 (plingeling) R 10851 10853 10627 0 -1 4203588 2661150 1253 0 0 498220 636 0 0 25 0 2 0 512337391 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5019.25
CPU time (s): 40000.6
CPU user time (s): 39941.6
CPU system time (s): 59.02
CPU usage (%): 796.945
Max. virtual memory (cumulated for all children) (KiB): 19051932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39941.6
system time used= 59.02
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26258407
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1031
involuntary context switches= 192232

runsolver used 7.52486 second user time and 19.823 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-28 18:15:53
IDJOB=3309591
IDBENCH=82404
IDSOLVER=1695
FILE ID=node106/3309591-1304007348
RUNJOBID= node106-1304002341-10641
PBS_JOBID= 13168791
Free space on /tmp= 72000 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309591-1304007348/watcher-3309591-1304007348 -o /tmp/evaluation-result-3309591-1304007348/solver-3309591-1304007348 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309591-1304007348.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6c2d25eda70423643946d76935ceb950
RANDOM SEED=641958445

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30375548 kB
Buffers:        197976 kB
Cached:        2101604 kB
SwapCached:         88 kB
Active:         822820 kB
Inactive:      1540260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30375548 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:          165680 kB
Writeback:           0 kB
AnonPages:       63164 kB
Mapped:          14476 kB
Slab:           146448 kB
PageTables:       4196 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188664 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71996 MiB
End job on node106 at 2011-04-28 19:39:34