Trace number 3371178

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.27 1203.83

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n180-s34713902-sat.cnf
MD5SUM19292459de25c4f5e9e6f187c00d549d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.431934
Satisfiable
(Un)Satisfiability was proved
Number of variables180
Number of clauses432
Sum of the clauses size1080
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2360
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 572
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371178-1305423993/watcher-3371178-1305423993 -o /tmp/evaluation-result-3371178-1305423993/solver-3371178-1305423993 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371178-1305423993.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.94 7.73 6/355 10209
/proc/meminfo: memFree=17764808/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=49836 CPUtime=0 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 321 1251 0 0 0 0 0 0 25 0 5 0 732629985 51032064 247 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 12459 247 172 55 0 10345 0
[pid=10209/tid=10215] ppid=10207 vsize=115508 CPUtime=0 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 52 1251 0 0 0 0 0 0 25 0 5 0 732629985 118280192 318 33554432000 4194304 4417452 140735824856032 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=115508 CPUtime=0 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 10 1251 0 0 0 0 0 0 25 0 5 0 732629985 118280192 318 33554432000 4194304 4417452 140735824856032 18446744073709551615 256415085549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=115508 CPUtime=0 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 3 1251 0 0 0 0 0 0 25 0 5 0 732629985 118280192 318 33554432000 4194304 4417452 140735824856032 18446744073709551615 256415496686 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=115508 CPUtime=0 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 31 1251 0 0 0 0 0 0 25 0 5 0 732629985 118280192 318 33554432000 4194304 4417452 140735824856032 18446744073709551615 4356485 0 0 4096 17442 0 0 0 -1 4 0 0 0

[startup+0.138529 s]
/proc/loadavg: 7.44 7.94 7.73 6/355 10209
/proc/meminfo: memFree=17764808/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=118440 CPUtime=0.51 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 1507 1251 0 0 51 0 0 0 25 0 5 0 732629985 121282560 1057 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 29610 1057 180 55 0 27496 0
[pid=10209/tid=10215] ppid=10207 vsize=118440 CPUtime=0.13 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 412 1251 0 0 13 0 0 0 25 0 5 0 732629985 121282560 1057 33554432000 4194304 4417452 140735824856032 18446744073709551615 4357869 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=118440 CPUtime=0.12 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 154 1251 0 0 12 0 0 0 25 0 5 0 732629985 121282560 1057 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=118440 CPUtime=0.12 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 211 1251 0 0 12 0 0 0 25 0 5 0 732629985 121282560 1057 33554432000 4194304 4417452 140735824856032 18446744073709551615 4353896 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=118440 CPUtime=0.13 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 434 1251 0 0 13 0 0 0 25 0 5 0 732629985 121282560 1057 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 118440

[startup+0.200518 s]
/proc/loadavg: 7.44 7.94 7.73 6/355 10209
/proc/meminfo: memFree=17764808/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=118752 CPUtime=0.76 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 1896 1251 0 0 76 0 0 0 25 0 5 0 732629985 121602048 1136 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 29688 1136 180 55 0 27574 0
[pid=10209/tid=10215] ppid=10207 vsize=118752 CPUtime=0.19 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 449 1251 0 0 19 0 0 0 25 0 5 0 732629985 121602048 1136 33554432000 4194304 4417452 140735824856032 18446744073709551615 4365294 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=118752 CPUtime=0.19 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 275 1251 0 0 19 0 0 0 25 0 5 0 732629985 121602048 1136 33554432000 4194304 4417452 140735824856032 18446744073709551615 4309168 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=118752 CPUtime=0.18 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 291 1251 0 0 18 0 0 0 25 0 5 0 732629985 121602048 1136 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=118752 CPUtime=0.19 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 585 1251 0 0 19 0 0 0 25 0 5 0 732629985 121602048 1136 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 118752

[startup+0.3005 s]
/proc/loadavg: 7.44 7.94 7.73 6/355 10209
/proc/meminfo: memFree=17764808/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=120708 CPUtime=1.16 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 2928 1251 0 0 116 0 0 0 25 0 5 0 732629985 123604992 1627 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 30177 1627 180 55 0 28063 0
[pid=10209/tid=10215] ppid=10207 vsize=120708 CPUtime=0.29 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 695 1251 0 0 29 0 0 0 25 0 5 0 732629985 123604992 1627 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=120708 CPUtime=0.29 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 387 1251 0 0 29 0 0 0 25 0 5 0 732629985 123604992 1627 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=120708 CPUtime=0.28 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 584 1251 0 0 28 0 0 0 25 0 5 0 732629985 123604992 1627 33554432000 4194304 4417452 140735824856032 18446744073709551615 4353653 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=120708 CPUtime=0.29 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 966 1251 0 0 29 0 0 0 25 0 5 0 732629985 123604992 1627 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 120708

[startup+0.700425 s]
/proc/loadavg: 7.44 7.94 7.73 6/355 10209
/proc/meminfo: memFree=17764808/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=122932 CPUtime=2.76 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 6150 1251 0 0 275 1 0 0 25 0 5 0 732629985 125882368 2187 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 30733 2187 180 55 0 28619 0
[pid=10209/tid=10215] ppid=10207 vsize=122932 CPUtime=0.69 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 1304 1251 0 0 69 0 0 0 25 0 5 0 732629985 125882368 2187 33554432000 4194304 4417452 140735824856032 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=122932 CPUtime=0.68 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 1440 1251 0 0 68 0 0 0 25 0 5 0 732629985 125882368 2187 33554432000 4194304 4417452 140735824856032 18446744073709551615 4250488 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=122932 CPUtime=0.68 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 1369 1251 0 0 68 0 0 0 25 0 5 0 732629985 125882368 2187 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364508 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=122932 CPUtime=0.68 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 1741 1251 0 0 68 0 0 0 25 0 5 0 732629985 125882368 2187 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 122932

[startup+1.50028 s]
/proc/loadavg: 7.44 7.94 7.73 9/360 10219
/proc/meminfo: memFree=17748708/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=125472 CPUtime=5.95 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 11663 1251 0 0 593 2 0 0 25 0 5 0 732629985 128483328 2822 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 31368 2822 180 55 0 29254 0
[pid=10209/tid=10215] ppid=10207 vsize=125472 CPUtime=1.49 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 2669 1251 0 0 149 0 0 0 25 0 5 0 732629985 128483328 2822 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=125472 CPUtime=1.48 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 2741 1251 0 0 148 0 0 0 25 0 5 0 732629985 128483328 2822 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=125472 CPUtime=1.46 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 2643 1251 0 0 146 0 0 0 25 0 5 0 732629985 128483328 2822 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=125472 CPUtime=1.48 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 3314 1251 0 0 148 0 0 0 25 0 5 0 732629985 128483328 2822 33554432000 4194304 4417452 140735824856032 18446744073709551615 4366105 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 125472

[startup+3.10098 s]
/proc/loadavg: 7.44 7.94 7.73 9/360 10219
/proc/meminfo: memFree=17741144/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=132432 CPUtime=12.33 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 19739 1251 0 0 1231 2 0 0 25 0 5 0 732629985 135610368 4562 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 33108 4562 180 55 0 30994 0
[pid=10209/tid=10215] ppid=10207 vsize=132432 CPUtime=3.08 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 4372 1251 0 0 308 0 0 0 25 0 5 0 732629985 135610368 4562 33554432000 4194304 4417452 140735824856032 18446744073709551615 4353982 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=132432 CPUtime=3.08 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 5165 1251 0 0 308 0 0 0 25 0 5 0 732629985 135610368 4562 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=132432 CPUtime=3.05 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 4736 1251 0 0 305 0 0 0 25 0 5 0 732629985 135610368 4562 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=132432 CPUtime=3.08 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 5170 1251 0 0 308 0 0 0 25 0 5 0 732629985 135610368 4562 33554432000 4194304 4417452 140735824856032 18446744073709551615 4343787 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 132432

[startup+6.30037 s]
/proc/loadavg: 7.49 7.94 7.73 9/360 10219
/proc/meminfo: memFree=17733700/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=137288 CPUtime=25.1 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 33414 1251 0 0 2505 5 0 0 25 0 5 0 732629985 140582912 5805 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 34322 5805 180 55 0 32208 0
[pid=10209/tid=10215] ppid=10207 vsize=137288 CPUtime=6.29 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 7967 1251 0 0 628 1 0 0 25 0 5 0 732629985 140582912 5805 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=137288 CPUtime=6.28 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 8306 1251 0 0 628 0 0 0 25 0 5 0 732629985 140582912 5805 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=137288 CPUtime=6.21 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 8048 1251 0 0 620 1 0 0 25 0 5 0 732629985 140582912 5805 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=137288 CPUtime=6.28 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 8797 1251 0 0 627 1 0 0 25 0 5 0 732629985 140582912 5805 33554432000 4194304 4417452 140735824856032 18446744073709551615 4354631 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 137288

[startup+12.7012 s]
/proc/loadavg: 7.53 7.94 7.73 9/360 10219
/proc/meminfo: memFree=17712316/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=137832 CPUtime=50.63 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 54589 1251 0 0 5055 8 0 0 25 0 5 0 732629985 141139968 5939 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 34458 5939 180 55 0 32344 0
[pid=10209/tid=10215] ppid=10207 vsize=137832 CPUtime=12.69 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 13473 1251 0 0 1268 1 0 0 25 0 5 0 732629985 141139968 5939 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=137832 CPUtime=12.68 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 13797 1251 0 0 1267 1 0 0 25 0 5 0 732629985 141139968 5939 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364896 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=137832 CPUtime=12.55 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 13056 1251 0 0 1253 2 0 0 25 0 5 0 732629985 141139968 5939 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=137832 CPUtime=12.69 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 13967 1251 0 0 1267 2 0 0 25 0 5 0 732629985 141139968 5939 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 137832

[startup+25.5007 s]
/proc/loadavg: 7.63 7.94 7.73 9/360 10220
/proc/meminfo: memFree=17691352/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=143336 CPUtime=101.69 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 81754 1251 0 0 10157 12 0 0 25 0 5 0 732629985 146776064 7316 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 35834 7316 180 55 0 33720 0
[pid=10209/tid=10215] ppid=10207 vsize=143336 CPUtime=25.49 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 20435 1251 0 0 2547 2 0 0 25 0 5 0 732629985 146776064 7316 33554432000 4194304 4417452 140735824856032 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=143336 CPUtime=25.49 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 19695 1251 0 0 2546 3 0 0 25 0 5 0 732629985 146776064 7316 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=143336 CPUtime=25.2 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 20875 1251 0 0 2517 3 0 0 25 0 5 0 732629985 146776064 7316 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=143336 CPUtime=25.49 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 20453 1251 0 0 2546 3 0 0 25 0 5 0 732629985 146776064 7316 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.69
Current children cumulated vsize (KiB) 143336

[startup+51.1009 s]
/proc/loadavg: 7.90 7.98 7.75 9/360 10220
/proc/meminfo: memFree=17672000/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=155944 CPUtime=203.8 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 131063 1251 0 0 20360 20 0 0 25 0 5 0 732629985 159686656 10440 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 38986 10440 180 55 0 36872 0
[pid=10209/tid=10215] ppid=10207 vsize=155944 CPUtime=51.09 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 32662 1251 0 0 5104 5 0 0 25 0 5 0 732629985 159686656 10440 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=155944 CPUtime=51.08 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 30595 1251 0 0 5104 4 0 0 25 0 5 0 732629985 159686656 10440 33554432000 4194304 4417452 140735824856032 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=155944 CPUtime=50.52 cores=0,2,4,6

################
# More data... #
################

[pid=10209/tid=10216] ppid=10207 vsize=232556 CPUtime=762.32 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 175877 1251 0 0 76207 25 0 0 25 0 5 0 732629985 238137344 29551 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=232556 CPUtime=753.76 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 187018 1251 0 0 75345 31 0 0 25 0 5 0 732629985 238137344 29551 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=232556 CPUtime=762.32 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 198975 1251 0 0 76202 30 0 0 25 0 5 0 732629985 238137344 29551 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3040.74
Current children cumulated vsize (KiB) 232556

[startup+822.3 s]
/proc/loadavg: 8.04 8.09 7.93 9/360 10241
/proc/meminfo: memFree=17521288/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=208412 CPUtime=3280.05 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 784379 1251 0 0 327881 124 0 0 25 0 5 0 732629985 213413888 23586 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 52103 23586 180 55 0 49989 0
[pid=10209/tid=10215] ppid=10207 vsize=208412 CPUtime=822.31 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 195735 1251 0 0 82200 31 0 0 25 0 5 0 732629985 213413888 23586 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=208412 CPUtime=822.31 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 185030 1251 0 0 82204 27 0 0 25 0 5 0 732629985 213413888 23586 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=208412 CPUtime=813.09 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 197106 1251 0 0 81276 33 0 0 25 0 5 0 732629985 213413888 23586 33554432000 4194304 4417452 140735824856032 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=208412 CPUtime=822.31 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 206212 1251 0 0 82200 31 0 0 25 0 5 0 732629985 213413888 23586 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3280.05
Current children cumulated vsize (KiB) 208412

[startup+882.314 s]
/proc/loadavg: 8.01 8.07 7.93 9/360 10252
/proc/meminfo: memFree=17481544/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=233304 CPUtime=3519.42 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 816697 1251 0 0 351814 128 0 0 25 0 5 0 732629985 238903296 29809 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 58326 29809 180 55 0 56212 0
[pid=10209/tid=10215] ppid=10207 vsize=233304 CPUtime=882.32 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 202418 1251 0 0 88200 32 0 0 25 0 5 0 732629985 238903296 29809 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=233304 CPUtime=882.33 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 194538 1251 0 0 88204 29 0 0 25 0 5 0 732629985 238903296 29809 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=233304 CPUtime=872.41 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 205439 1251 0 0 87207 34 0 0 25 0 5 0 732629985 238903296 29809 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=233304 CPUtime=882.33 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 214006 1251 0 0 88201 32 0 0 25 0 5 0 732629985 238903296 29809 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3519.42
Current children cumulated vsize (KiB) 233304

[startup+942.301 s]
/proc/loadavg: 8.33 8.14 7.95 10/365 10691
/proc/meminfo: memFree=17491000/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=204564 CPUtime=3757.37 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 856018 1251 0 0 375602 135 0 0 25 0 5 0 732629985 209473536 22625 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 51141 22625 180 55 0 49027 0
[pid=10209/tid=10215] ppid=10207 vsize=204564 CPUtime=941.27 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 211665 1251 0 0 94093 34 0 0 25 0 5 0 732629985 209473536 22625 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=204564 CPUtime=942.2 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 202012 1251 0 0 94191 29 0 0 25 0 5 0 732629985 209473536 22625 33554432000 4194304 4417452 140735824856032 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=204564 CPUtime=931.62 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 217339 1251 0 0 93126 36 0 0 25 0 5 0 732629985 209473536 22625 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=204564 CPUtime=942.25 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 224706 1251 0 0 94191 34 0 0 25 0 5 0 732629985 209473536 22625 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3757.37
Current children cumulated vsize (KiB) 204564

[startup+1002.3 s]
/proc/loadavg: 8.82 8.31 8.02 10/365 10950
/proc/meminfo: memFree=17475792/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=216172 CPUtime=3996.64 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 890417 1251 0 0 399523 141 0 0 25 0 5 0 732629985 221360128 25495 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 54043 25495 180 55 0 51929 0
[pid=10209/tid=10215] ppid=10207 vsize=216172 CPUtime=1001.27 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 220472 1251 0 0 100093 34 0 0 25 0 5 0 732629985 221360128 25495 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=216172 CPUtime=1002.2 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 209683 1251 0 0 100190 30 0 0 25 0 5 0 732629985 221360128 25495 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=216172 CPUtime=990.89 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 224606 1251 0 0 99052 37 0 0 25 0 5 0 732629985 221360128 25495 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=216172 CPUtime=1002.23 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 235360 1251 0 0 100186 37 0 0 25 0 5 0 732629985 221360128 25495 33554432000 4194304 4417452 140735824856032 18446744073709551615 4365088 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3996.64
Current children cumulated vsize (KiB) 216172

[startup+1062.3 s]
/proc/loadavg: 9.11 8.48 8.10 10/365 11147
/proc/meminfo: memFree=17407784/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=226848 CPUtime=4235.91 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 921655 1251 0 0 423445 146 0 0 25 0 5 0 732629985 232292352 28164 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 56712 28164 180 55 0 54598 0
[pid=10209/tid=10215] ppid=10207 vsize=226848 CPUtime=1061.27 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 226940 1251 0 0 106092 35 0 0 25 0 5 0 732629985 232292352 28164 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=226848 CPUtime=1062.21 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 217040 1251 0 0 106189 32 0 0 25 0 5 0 732629985 232292352 28164 33554432000 4194304 4417452 140735824856032 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=226848 CPUtime=1050.19 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 232695 1251 0 0 104981 38 0 0 25 0 5 0 732629985 232292352 28164 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=226848 CPUtime=1062.22 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 244684 1251 0 0 106182 40 0 0 25 0 5 0 732629985 232292352 28164 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4235.91
Current children cumulated vsize (KiB) 226848

[startup+1122.3 s]
/proc/loadavg: 9.17 8.60 8.16 10/366 11343
/proc/meminfo: memFree=17426864/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=236028 CPUtime=4475.17 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 959620 1251 0 0 447362 155 0 0 25 0 5 0 732629985 241692672 30491 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 59007 30491 180 55 0 56893 0
[pid=10209/tid=10215] ppid=10207 vsize=236028 CPUtime=1121.27 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 238643 1251 0 0 112089 38 0 0 25 0 5 0 732629985 241692672 30491 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=236028 CPUtime=1122.21 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 227389 1251 0 0 112187 34 0 0 25 0 5 0 732629985 241692672 30491 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=236028 CPUtime=1109.46 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 238242 1251 0 0 110907 39 0 0 25 0 5 0 732629985 241692672 30491 33554432000 4194304 4417452 140735824856032 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=236028 CPUtime=1122.2 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 255050 1251 0 0 112177 43 0 0 25 0 5 0 732629985 241692672 30491 33554432000 4194304 4417452 140735824856032 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4475.17
Current children cumulated vsize (KiB) 236028

[startup+1182.3 s]
/proc/loadavg: 9.18 8.70 8.22 10/365 11546
/proc/meminfo: memFree=17396932/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=231984 CPUtime=4714.45 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 985294 1251 0 0 471285 160 0 0 25 0 5 0 732629985 237551616 29448 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 57996 29448 180 55 0 55882 0
[pid=10209/tid=10215] ppid=10207 vsize=231984 CPUtime=1181.27 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 246211 1251 0 0 118088 39 0 0 25 0 5 0 732629985 237551616 29448 33554432000 4194304 4417452 140735824856032 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=231984 CPUtime=1182.21 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 234298 1251 0 0 118186 35 0 0 25 0 5 0 732629985 237551616 29448 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=231984 CPUtime=1168.75 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 244729 1251 0 0 116835 40 0 0 25 0 5 0 732629985 237551616 29448 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=231984 CPUtime=1182.19 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 259760 1251 0 0 118175 44 0 0 25 0 5 0 732629985 237551616 29448 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4714.45
Current children cumulated vsize (KiB) 231984



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.8 s]
/proc/loadavg: 9.13 8.72 8.24 5/359 11652
/proc/meminfo: memFree=17599452/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=235576 CPUtime=4800.2 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 995977 1251 0 0 479858 162 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 58894 30346 180 55 0 56780 0
[pid=10209/tid=10215] ppid=10207 vsize=235576 CPUtime=1202.79 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 248430 1251 0 0 120239 40 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=235576 CPUtime=1203.72 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 234298 1251 0 0 120337 35 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=235576 CPUtime=1189.98 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 244729 1251 0 0 118958 40 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=235576 CPUtime=1203.7 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 268224 1251 0 0 120324 46 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 235576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.8 s]
/proc/loadavg: 9.13 8.72 8.24 5/359 11652
/proc/meminfo: memFree=17599452/32950928 swapFree=67111200/67111528
[pid=10209] ppid=10207 vsize=235576 CPUtime=4800.2 cores=0,2,4,6
/proc/10209/stat : 10209 (plingeling) S 10207 10209 10053 0 -1 4202496 995977 1251 0 0 479858 162 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/10209/statm: 58894 30346 180 55 0 56780 0
[pid=10209/tid=10215] ppid=10207 vsize=235576 CPUtime=1202.79 cores=0,2,4,6
/proc/10209/task/10215/stat : 10215 (plingeling) R 10207 10209 10053 0 -1 4202560 248430 1251 0 0 120239 40 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10209/tid=10216] ppid=10207 vsize=235576 CPUtime=1203.72 cores=0,2,4,6
/proc/10209/task/10216/stat : 10216 (plingeling) R 10207 10209 10053 0 -1 4202560 234298 1251 0 0 120337 35 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10209/tid=10217] ppid=10207 vsize=235576 CPUtime=1189.98 cores=0,2,4,6
/proc/10209/task/10217/stat : 10217 (plingeling) R 10207 10209 10053 0 -1 4202560 244729 1251 0 0 118958 40 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10209/tid=10218] ppid=10207 vsize=235576 CPUtime=1203.7 cores=0,2,4,6
/proc/10209/task/10218/stat : 10218 (plingeling) R 10207 10209 10053 0 -1 4202560 268224 1251 0 0 120324 46 0 0 25 0 5 0 732629985 241229824 30346 33554432000 4194304 4417452 140735824856032 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 235576

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.83
CPU time (s): 4800.27
CPU user time (s): 4798.63
CPU system time (s): 1.63975
CPU usage (%): 398.751
Max. virtual memory (cumulated for all children) (KiB): 267752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.63
system time used= 1.63975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 997228
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 104
involuntary context switches= 27033

runsolver used 3.81542 second user time and 9.75852 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-15 03:46:33
IDJOB=3371178
IDBENCH=83141
IDSOLVER=1848
FILE ID=node115/3371178-1305423993
RUNJOBID= node115-1305422787-10071
PBS_JOBID= 13324588
Free space on /tmp= 73236 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n180-s34713902-sat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371178-1305423993/watcher-3371178-1305423993 -o /tmp/evaluation-result-3371178-1305423993/solver-3371178-1305423993 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371178-1305423993.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 19292459de25c4f5e9e6f187c00d549d
RANDOM SEED=1188977451

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17764964 kB
Buffers:        293648 kB
Cached:        4541556 kB
SwapCached:          0 kB
Active:       11991336 kB
Inactive:      2877192 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17764964 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:              36 kB
Writeback:           0 kB
AnonPages:    10033048 kB
Mapped:          28228 kB
Slab:           211068 kB
PageTables:      40552 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 69715484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73224 MiB
End job on node115 at 2011-05-15 04:06:39