Trace number 3372638

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 1254.33 158.704

General information on the benchmark

Nameapplication/manthey/traffic/
traffic_kkb_unknown.cnf
MD5SUM254fcd4eae8129ad5842f186e24e0793
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark105.068
Satisfiable
(Un)Satisfiability was proved
Number of variables34510
Number of clauses701694
Sum of the clauses size2616281
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 252869
Number of clauses of size 384757
Number of clauses of size 4564068
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

1254.31/158.70	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372638-1305439475/watcher-3372638-1305439475 -o /tmp/evaluation-result-3372638-1305439475/solver-3372638-1305439475 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372638-1305439475.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.46 7.86 7.78 1/323 32400
/proc/meminfo: memFree=22949840/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=11832 CPUtime=0 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 1044 1250 0 0 0 0 0 0 22 0 1 0 636363179 12115968 973 33554432000 4194304 4417452 140733935567296 18446744073709551615 270338383616 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 2958 973 147 55 0 844 0

[startup+0.0750601 s]
/proc/loadavg: 7.46 7.86 7.78 1/323 32400
/proc/meminfo: memFree=22949840/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=30544 CPUtime=0.06 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 5731 1250 0 0 6 0 0 0 22 0 1 0 636363179 31277056 5660 33554432000 4194304 4417452 140733935567296 18446744073709551615 270338383616 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 7636 5660 148 55 0 5522 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 30544

[startup+0.101053 s]
/proc/loadavg: 7.46 7.86 7.78 1/323 32400
/proc/meminfo: memFree=22949840/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=51408 CPUtime=0.09 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 10986 1250 0 0 8 1 0 0 22 0 1 0 636363179 52641792 10876 33554432000 4194304 4417452 140733935567296 18446744073709551615 4231277 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 12852 10876 148 55 0 10738 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 51408

[startup+0.301011 s]
/proc/loadavg: 7.46 7.86 7.78 1/323 32400
/proc/meminfo: memFree=22949840/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=96496 CPUtime=0.28 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 22307 1250 0 0 26 2 0 0 23 0 1 0 636363179 98811904 22149 33554432000 4194304 4417452 140733935567296 18446744073709551615 4227779 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 24124 22149 149 55 0 22010 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 96496

[startup+0.700934 s]
/proc/loadavg: 7.46 7.86 7.78 1/323 32400
/proc/meminfo: memFree=22949840/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=145648 CPUtime=0.69 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 34595 1250 0 0 65 4 0 0 25 0 1 0 636363179 149143552 34437 33554432000 4194304 4417452 140733935567296 18446744073709551615 4274358 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 36412 34437 149 55 0 34298 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 145648

[startup+1.50079 s]
/proc/loadavg: 7.46 7.86 7.78 2/324 32406
/proc/meminfo: memFree=22713620/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=309488 CPUtime=1.49 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 75555 1250 0 0 140 9 0 0 25 0 1 0 636363179 316915712 75397 33554432000 4194304 4417452 140733935567296 18446744073709551615 4259882 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/32400/statm: 77372 75397 149 55 0 75258 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 309488

[startup+3.10043 s]
/proc/loadavg: 7.46 7.86 7.78 9/332 32414
/proc/meminfo: memFree=22559908/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=543068 CPUtime=11.49 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 127684 1250 0 0 1134 15 0 0 18 0 9 0 636363179 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 135767 98256 177 55 0 133653 0
[pid=32400/tid=32407] ppid=32398 vsize=543068 CPUtime=1.19 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 2544 1250 0 0 119 0 0 0 19 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=543068 CPUtime=1.18 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 2782 1250 0 0 118 0 0 0 25 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4270966 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=543068 CPUtime=1.2 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 2756 1250 0 0 120 0 0 0 19 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4274287 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=543068 CPUtime=1.2 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 237 1250 0 0 120 0 0 0 19 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4353830 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=543068 CPUtime=1.2 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 3037 1250 0 0 120 0 0 0 22 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4260714 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=543068 CPUtime=1.19 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 2132 1250 0 0 119 0 0 0 19 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4275947 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=543068 CPUtime=1.2 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 3182 1250 0 0 120 0 0 0 22 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4274354 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=543068 CPUtime=1.2 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 2674 1250 0 0 120 0 0 0 22 0 9 0 636363369 556101632 98256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4260101 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.49
Current children cumulated vsize (KiB) 543068

[startup+6.30079 s]
/proc/loadavg: 7.58 7.88 7.79 9/332 32415
/proc/meminfo: memFree=22533620/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=561780 CPUtime=37.06 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 136560 1250 0 0 3688 18 0 0 18 0 9 0 636363179 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 140445 103253 180 55 0 138331 0
[pid=32400/tid=32407] ppid=32398 vsize=561780 CPUtime=4.39 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 2951 1250 0 0 439 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4235378 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=561780 CPUtime=4.34 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 4492 1250 0 0 434 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=561780 CPUtime=4.4 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 5512 1250 0 0 439 1 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4377135 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=561780 CPUtime=4.4 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 237 1250 0 0 440 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=561780 CPUtime=4.4 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 3281 1250 0 0 440 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=561780 CPUtime=4.39 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 2618 1250 0 0 439 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=561780 CPUtime=4.4 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 5937 1250 0 0 439 1 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=561780 CPUtime=4.39 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 3192 1250 0 0 439 0 0 0 25 0 9 0 636363369 575262720 103253 33554432000 4194304 4417452 140733935567296 18446744073709551615 4236290 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.06
Current children cumulated vsize (KiB) 561780

[startup+12.7005 s]
/proc/loadavg: 7.61 7.88 7.79 9/332 32415
/proc/meminfo: memFree=22534552/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=561732 CPUtime=88.19 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 136802 1250 0 0 8801 18 0 0 18 0 9 0 636363179 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 140433 103483 180 55 0 138319 0
[pid=32400/tid=32407] ppid=32398 vsize=561732 CPUtime=10.79 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 3193 1250 0 0 1079 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=561732 CPUtime=10.67 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 4492 1250 0 0 1067 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=561732 CPUtime=10.8 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 5512 1250 0 0 1079 1 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=561732 CPUtime=10.8 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 237 1250 0 0 1080 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=561732 CPUtime=10.8 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 3281 1250 0 0 1080 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4365939 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=561732 CPUtime=10.79 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 2618 1250 0 0 1079 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=561732 CPUtime=10.8 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 5937 1250 0 0 1079 1 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4365042 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=561732 CPUtime=10.79 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 3192 1250 0 0 1079 0 0 0 25 0 9 0 636363369 575213568 103483 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 88.19
Current children cumulated vsize (KiB) 561732

[startup+25.501 s]
/proc/loadavg: 7.70 7.89 7.79 9/332 32415
/proc/meminfo: memFree=22531188/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=570772 CPUtime=190.46 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 140692 1250 0 0 19027 19 0 0 18 0 9 0 636363179 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 142693 104997 180 55 0 140579 0
[pid=32400/tid=32407] ppid=32398 vsize=570772 CPUtime=23.59 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 4992 1250 0 0 2359 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=570772 CPUtime=23.33 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 5072 1250 0 0 2333 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=570772 CPUtime=23.6 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 5904 1250 0 0 2359 1 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=570772 CPUtime=23.6 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 237 1250 0 0 2360 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=570772 CPUtime=23.6 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 4035 1250 0 0 2360 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=570772 CPUtime=23.59 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 2767 1250 0 0 2359 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=570772 CPUtime=23.6 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6112 1250 0 0 2359 1 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=570772 CPUtime=23.59 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 3233 1250 0 0 2359 0 0 0 25 0 9 0 636363369 584470528 104997 33554432000 4194304 4417452 140733935567296 18446744073709551615 4290328 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 190.46
Current children cumulated vsize (KiB) 570772

[startup+51.1009 s]
/proc/loadavg: 7.88 7.91 7.80 9/332 32416
/proc/meminfo: memFree=22533884/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=567364 CPUtime=394.99 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 149931 1250 0 0 39479 20 0 0 18 0 9 0 636363179 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141841 104250 180 55 0 139727 0
[pid=32400/tid=32407] ppid=32398 vsize=567364 CPUtime=49.19 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 7994 1250 0 0 4918 1 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=567364 CPUtime=48.67 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 5367 1250 0 0 4867 0 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=567364 CPUtime=49.2 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 5904 1250 0 0 4919 1 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=567364 CPUtime=49.2 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 789 1250 0 0 4920 0 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4353546 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=567364 CPUtime=49.2 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 5667 1250 0 0 4919 1 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=567364 CPUtime=49.18 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 4466 1250 0 0 4918 0 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=567364 CPUtime=49.2 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6112 1250 0 0 4919 1 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=567364 CPUtime=49.19 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5292 1250 0 0 4918 1 0 0 25 0 9 0 636363369 580980736 104250 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 394.99
Current children cumulated vsize (KiB) 567364

[startup+102.313 s]
/proc/loadavg: 7.95 7.92 7.81 9/332 32417

################
# More data... #
################

/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 12600 0 0 0 25 0 9 0 636363369 590913536 107036 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=577064 CPUtime=126 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 12599 1 0 0 25 0 9 0 636363369 590913536 107036 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=577064 CPUtime=125.98 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 12598 0 0 0 25 0 9 0 636363369 590913536 107036 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=577064 CPUtime=126 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6517 1250 0 0 12599 1 0 0 25 0 9 0 636363369 590913536 107036 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=577064 CPUtime=125.98 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5731 1250 0 0 12597 1 0 0 25 0 9 0 636363369 590913536 107036 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1008.61
Current children cumulated vsize (KiB) 577064

[startup+140.701 s]
/proc/loadavg: 7.97 7.93 7.82 9/332 32418
/proc/meminfo: memFree=22531640/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=565104 CPUtime=1110.97 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 165117 1250 0 0 111075 22 0 0 18 0 9 0 636363179 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141276 104193 180 55 0 139162 0
[pid=32400/tid=32407] ppid=32398 vsize=565104 CPUtime=138.81 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 16916 1250 0 0 13879 2 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=565104 CPUtime=137.35 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 13735 0 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=565104 CPUtime=138.82 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 13881 1 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=565104 CPUtime=138.82 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 13882 0 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=565104 CPUtime=138.82 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 13881 1 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4306923 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=565104 CPUtime=138.8 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 13880 0 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4330541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=565104 CPUtime=138.82 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6950 1250 0 0 13881 1 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4330515 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=565104 CPUtime=138.79 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 13878 1 0 0 25 0 9 0 636363369 578666496 104193 33554432000 4194304 4417452 140733935567296 18446744073709551615 4259186 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1110.97
Current children cumulated vsize (KiB) 565104

[startup+147.101 s]
/proc/loadavg: 7.97 7.93 7.82 9/332 32418
/proc/meminfo: memFree=22531392/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=564244 CPUtime=1162.02 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 165574 1250 0 0 116180 22 0 0 18 0 9 0 636363179 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141061 104222 180 55 0 138947 0
[pid=32400/tid=32407] ppid=32398 vsize=564244 CPUtime=145.2 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 17367 1250 0 0 14518 2 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=564244 CPUtime=143.68 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 14368 0 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=564244 CPUtime=145.2 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 14519 1 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=564244 CPUtime=145.21 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 14521 0 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=564244 CPUtime=145.2 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 14519 1 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4252041 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=564244 CPUtime=145.18 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 14518 0 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=564244 CPUtime=145.2 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6956 1250 0 0 14519 1 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=564244 CPUtime=145.18 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 14517 1 0 0 25 0 9 0 636363369 577785856 104222 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1162.02
Current children cumulated vsize (KiB) 564244

[startup+153.501 s]
/proc/loadavg: 7.98 7.93 7.82 9/332 32418
/proc/meminfo: memFree=22527176/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=564244 CPUtime=1213.15 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 166786 1250 0 0 121293 22 0 0 18 0 9 0 636363179 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141061 104443 180 55 0 138947 0
[pid=32400/tid=32407] ppid=32398 vsize=564244 CPUtime=151.6 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 18579 1250 0 0 15158 2 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=564244 CPUtime=150.01 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 15001 0 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=564244 CPUtime=151.6 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 15159 1 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=564244 CPUtime=151.61 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 15161 0 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=564244 CPUtime=151.6 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 15159 1 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=564244 CPUtime=151.58 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 15158 0 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=564244 CPUtime=151.6 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6956 1250 0 0 15159 1 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=564244 CPUtime=151.58 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 15157 1 0 0 25 0 9 0 636363369 577785856 104443 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1213.15
Current children cumulated vsize (KiB) 564244

[startup+156.701 s]
/proc/loadavg: 7.98 7.93 7.82 9/332 32419
/proc/meminfo: memFree=22531516/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=564204 CPUtime=1238.72 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 166988 1250 0 0 123850 22 0 0 18 0 9 0 636363179 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141051 104256 180 55 0 138937 0
[pid=32400/tid=32407] ppid=32398 vsize=564204 CPUtime=154.8 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 18781 1250 0 0 15478 2 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=564204 CPUtime=153.18 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 15318 0 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=564204 CPUtime=154.8 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 15479 1 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=564204 CPUtime=154.81 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 15481 0 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=564204 CPUtime=154.8 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 15479 1 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=564204 CPUtime=154.79 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 15479 0 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=564204 CPUtime=154.81 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6956 1250 0 0 15480 1 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=564204 CPUtime=154.78 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 15477 1 0 0 25 0 9 0 636363369 577744896 104256 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1238.72
Current children cumulated vsize (KiB) 564204

[startup+157.501 s]
/proc/loadavg: 7.98 7.93 7.82 9/332 32419
/proc/meminfo: memFree=22532152/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=564200 CPUtime=1245.1 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 167507 1250 0 0 124488 22 0 0 18 0 9 0 636363179 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141050 103978 180 55 0 138936 0
[pid=32400/tid=32407] ppid=32398 vsize=564200 CPUtime=155.6 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 19300 1250 0 0 15558 2 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4247481 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=564200 CPUtime=153.97 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 15397 0 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=564200 CPUtime=155.6 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 15559 1 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=564200 CPUtime=155.61 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 15561 0 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=564200 CPUtime=155.6 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 15559 1 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=564200 CPUtime=155.59 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 15559 0 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4357040 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=564200 CPUtime=155.61 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6956 1250 0 0 15560 1 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4278151 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=564200 CPUtime=155.58 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 15557 1 0 0 25 0 9 0 636363369 577740800 103978 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1245.1
Current children cumulated vsize (KiB) 564200

[startup+158.301 s]
/proc/loadavg: 7.98 7.93 7.82 9/332 32419
/proc/meminfo: memFree=22533516/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=564196 CPUtime=1251.58 cores=0-7
/proc/32400/stat : 32400 (plingeling) S 32398 32400 31747 0 -1 4202496 167903 1250 0 0 125136 22 0 0 18 0 9 0 636363179 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32400/statm: 141049 103661 180 55 0 138935 0
[pid=32400/tid=32407] ppid=32398 vsize=564196 CPUtime=156.41 cores=0-7
/proc/32400/task/32407/stat : 32407 (plingeling) R 32398 32400 31747 0 -1 4202560 19696 1250 0 0 15639 2 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4275927 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=32400/tid=32408] ppid=32398 vsize=564196 CPUtime=154.77 cores=0-7
/proc/32400/task/32408/stat : 32408 (plingeling) R 32398 32400 31747 0 -1 4202560 6614 1250 0 0 15477 0 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32400/tid=32409] ppid=32398 vsize=564196 CPUtime=156.42 cores=0-7
/proc/32400/task/32409/stat : 32409 (plingeling) R 32398 32400 31747 0 -1 4202560 7054 1250 0 0 15641 1 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366486 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=32400/tid=32410] ppid=32398 vsize=564196 CPUtime=156.42 cores=0-7
/proc/32400/task/32410/stat : 32410 (plingeling) R 32398 32400 31747 0 -1 4202560 1662 1250 0 0 15642 0 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32400/tid=32411] ppid=32398 vsize=564196 CPUtime=156.42 cores=0-7
/proc/32400/task/32411/stat : 32411 (plingeling) R 32398 32400 31747 0 -1 4202560 6704 1250 0 0 15641 1 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32400/tid=32412] ppid=32398 vsize=564196 CPUtime=156.4 cores=0-7
/proc/32400/task/32412/stat : 32412 (plingeling) R 32398 32400 31747 0 -1 4202560 5127 1250 0 0 15640 0 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=32400/tid=32413] ppid=32398 vsize=564196 CPUtime=156.42 cores=0-7
/proc/32400/task/32413/stat : 32413 (plingeling) R 32398 32400 31747 0 -1 4202560 6956 1250 0 0 15641 1 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=32400/tid=32414] ppid=32398 vsize=564196 CPUtime=156.39 cores=0-7
/proc/32400/task/32414/stat : 32414 (plingeling) R 32398 32400 31747 0 -1 4202560 5750 1250 0 0 15638 1 0 0 25 0 9 0 636363369 577736704 103661 33554432000 4194304 4417452 140733935567296 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1251.58
Current children cumulated vsize (KiB) 564196

[startup+158.701 s]
/proc/loadavg: 7.98 7.93 7.82 9/332 32419
/proc/meminfo: memFree=22533516/32951124 swapFree=59367104/67111528
[pid=32400] ppid=32398 vsize=174616 CPUtime=1254.31 cores=0-7
/proc/32400/stat : 32400 (plingeling) R 32398 32400 31747 0 -1 4202496 167904 1250 0 0 125407 24 0 0 17 0 1 0 636363179 178806784 15653 33554432000 4194304 4417452 140733935567296 18446744073709551615 270338427015 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32400/statm: 43654 15204 181 55 0 41540 0
Current children cumulated CPU time (s) 1254.31
Current children cumulated vsize (KiB) 174616

Child status: 20
Real time (s): 158.704
CPU time (s): 1254.33
CPU user time (s): 1254.08
CPU system time (s): 0.250961
CPU usage (%): 790.36
Max. virtual memory (cumulated for all children) (KiB): 589656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1254.08
system time used= 0.250961
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 169157
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 244
involuntary context switches= 6037

runsolver used 0.487925 second user time and 1.16082 second system time

The end

Launcher Data 

Begin job on node143 at 2011-05-15 08:04:36
IDJOB=3372638
IDBENCH=82496
IDSOLVER=1851
FILE ID=node143/3372638-1305439475
RUNJOBID= node143-1305436493-31761
PBS_JOBID= 13324751
Free space on /tmp= 73536 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/manthey/traffic/traffic_kkb_unknown.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372638-1305439475/watcher-3372638-1305439475 -o /tmp/evaluation-result-3372638-1305439475/solver-3372638-1305439475 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372638-1305439475.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 254fcd4eae8129ad5842f186e24e0793
RANDOM SEED=1754702932

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22950244 kB
Buffers:        192056 kB
Cached:        1049284 kB
SwapCached:      67400 kB
Active:         169116 kB
Inactive:      9593904 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22950244 kB
SwapTotal:    67111528 kB
SwapFree:     59367104 kB
Dirty:           17488 kB
Writeback:           4 kB
AnonPages:     8453972 kB
Mapped:          22332 kB
Slab:           118836 kB
PageTables:      52612 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 69936740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73536 MiB
End job on node143 at 2011-05-15 08:07:14