Trace number 3309699

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 7714.59 966.261

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
MD5SUMa0ec1baa890da62d0c6df7f1e62c6af3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2133.18
Satisfiable
(Un)Satisfiability was proved
Number of variables163622
Number of clauses488120
Sum of the clauses size1138944
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2325412
Number of clauses of size 3162706
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

7714.51/966.26	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309699-1304007859/watcher-3309699-1304007859 -o /tmp/evaluation-result-3309699-1304007859/solver-3309699-1304007859 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309699-1304007859.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.91 7.58 2/170 19276
/proc/meminfo: memFree=17601248/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=11224 CPUtime=0 cores=0-7
/proc/19276/stat : 19276 (plingeling) R 19274 19276 19046 0 -1 4202496 880 1262 0 0 0 0 0 0 21 0 1 0 591016696 11493376 808 33554432000 4194304 4417332 140736103568976 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/19276/statm: 2806 808 147 55 0 692 0

[startup+0.0592269 s]
/proc/loadavg: 7.44 7.91 7.58 2/170 19276
/proc/meminfo: memFree=17601248/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=24324 CPUtime=0.05 cores=0-7
/proc/19276/stat : 19276 (plingeling) R 19274 19276 19046 0 -1 4202496 4202 1262 0 0 5 0 0 0 21 0 1 0 591016696 24907776 4104 33554432000 4194304 4417332 140736103568976 18446744073709551615 4231423 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/19276/statm: 6081 4104 148 55 0 3967 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 24324

[startup+0.100219 s]
/proc/loadavg: 7.44 7.91 7.58 2/170 19276
/proc/meminfo: memFree=17601248/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=28420 CPUtime=0.09 cores=0-7
/proc/19276/stat : 19276 (plingeling) R 19274 19276 19046 0 -1 4202496 5226 1262 0 0 9 0 0 0 21 0 1 0 591016696 29102080 5128 33554432000 4194304 4417332 140736103568976 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/19276/statm: 7105 5128 148 55 0 4991 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28420

[startup+0.301185 s]
/proc/loadavg: 7.44 7.91 7.58 2/170 19276
/proc/meminfo: memFree=17601248/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=81704 CPUtime=0.28 cores=0-7
/proc/19276/stat : 19276 (plingeling) R 19274 19276 19046 0 -1 4202496 18554 1262 0 0 26 2 0 0 22 0 1 0 591016696 83664896 18449 33554432000 4194304 4417332 140736103568976 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/19276/statm: 20426 18449 148 55 0 18312 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 81704

[startup+0.701114 s]
/proc/loadavg: 7.44 7.91 7.58 2/170 19276
/proc/meminfo: memFree=17601248/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=152116 CPUtime=0.68 cores=0-7
/proc/19276/stat : 19276 (plingeling) R 19274 19276 19046 0 -1 4202496 36157 1262 0 0 64 4 0 0 23 0 1 0 591016696 155766784 36052 33554432000 4194304 4417332 140736103568976 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/19276/statm: 38029 36052 148 55 0 35915 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 152116

[startup+1.50092 s]
/proc/loadavg: 7.44 7.91 7.58 2/171 19282
/proc/meminfo: memFree=17383064/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=381464 CPUtime=3.72 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 89021 1262 0 0 358 14 0 0 18 0 9 0 591016696 390619136 60676 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 95366 60676 167 55 0 93252 0
Current children cumulated CPU time (s) 3.72
Current children cumulated vsize (KiB) 381464

[startup+3.10064 s]
/proc/loadavg: 7.44 7.91 7.58 9/179 19290
/proc/meminfo: memFree=17346048/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=444116 CPUtime=16.5 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 150001 1262 0 0 1625 25 0 0 18 0 9 0 591016696 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 111029 74140 173 55 0 108915 0
[pid=19276/tid=19283] ppid=19274 vsize=444116 CPUtime=1.91 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 14046 1262 0 0 189 2 0 0 25 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=444116 CPUtime=1.9 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 12833 1262 0 0 188 2 0 0 25 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236655 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=444116 CPUtime=1.91 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 16697 1262 0 0 188 3 0 0 20 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=444116 CPUtime=1.91 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 3910 1262 0 0 191 0 0 0 25 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=444116 CPUtime=1.91 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 9853 1262 0 0 190 1 0 0 20 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4275762 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=444116 CPUtime=1.9 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 14096 1262 0 0 188 2 0 0 20 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4276590 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=444116 CPUtime=1.91 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 11925 1262 0 0 189 2 0 0 21 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4264403 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=444116 CPUtime=1.9 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 11906 1262 0 0 189 1 0 0 25 0 9 0 591016814 454774784 74140 33554432000 4194304 4417332 140736103568976 18446744073709551615 4276039 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 16.5
Current children cumulated vsize (KiB) 444116

[startup+6.30107 s]
/proc/loadavg: 7.49 7.91 7.58 9/179 19290
/proc/meminfo: memFree=17302280/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=465016 CPUtime=42.08 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 182250 1262 0 0 4179 29 0 0 18 0 9 0 591016696 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 116254 81542 180 55 0 114140 0
[pid=19276/tid=19283] ppid=19274 vsize=465016 CPUtime=5.11 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 17100 1262 0 0 509 2 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4240132 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=465016 CPUtime=5.1 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 13982 1262 0 0 508 2 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4253167 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=465016 CPUtime=5.1 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 22276 1262 0 0 506 4 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=465016 CPUtime=5.11 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 5960 1262 0 0 511 0 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=465016 CPUtime=5.1 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 14989 1262 0 0 508 2 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=465016 CPUtime=5.11 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 16843 1262 0 0 508 3 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4257101 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=465016 CPUtime=5.11 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 21193 1262 0 0 508 3 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 215988285136 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=465016 CPUtime=5.1 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 15172 1262 0 0 508 2 0 0 25 0 9 0 591016814 476176384 81542 33554432000 4194304 4417332 140736103568976 18446744073709551615 4334164 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 42.08
Current children cumulated vsize (KiB) 465016

[startup+12.701 s]
/proc/loadavg: 7.53 7.91 7.59 9/179 19290
/proc/meminfo: memFree=17203616/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=555344 CPUtime=93.25 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 207067 1262 0 0 9291 34 0 0 18 0 9 0 591016696 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 138836 103132 180 55 0 136722 0
[pid=19276/tid=19283] ppid=19274 vsize=555344 CPUtime=11.52 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 21198 1262 0 0 1149 3 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4253167 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=555344 CPUtime=11.51 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 18080 1262 0 0 1148 3 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4320304 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=555344 CPUtime=11.5 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 22276 1262 0 0 1146 4 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=555344 CPUtime=11.52 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 6193 1262 0 0 1151 1 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=555344 CPUtime=11.46 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 19085 1262 0 0 1143 3 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4235275 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=555344 CPUtime=11.5 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 20941 1262 0 0 1147 3 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=555344 CPUtime=11.51 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 21193 1262 0 0 1148 3 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4250980 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=555344 CPUtime=11.5 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 23366 1262 0 0 1146 4 0 0 25 0 9 0 591016814 568672256 103132 33554432000 4194304 4417332 140736103568976 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 93.25
Current children cumulated vsize (KiB) 555344

[startup+25.5007 s]
/proc/loadavg: 7.63 7.91 7.59 9/179 19291
/proc/meminfo: memFree=17291788/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=455904 CPUtime=195.56 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 208538 1262 0 0 19522 34 0 0 18 0 9 0 591016696 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 113976 77133 181 55 0 111862 0
[pid=19276/tid=19283] ppid=19274 vsize=455904 CPUtime=24.31 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 21522 1262 0 0 2428 3 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=455904 CPUtime=24.3 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 18406 1262 0 0 2427 3 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=455904 CPUtime=24.3 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 22345 1262 0 0 2426 4 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4264920 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=455904 CPUtime=24.32 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 6193 1262 0 0 2431 1 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4237273 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=455904 CPUtime=24.19 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 19110 1262 0 0 2416 3 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=455904 CPUtime=24.3 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 21267 1262 0 0 2427 3 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364355 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=455904 CPUtime=24.31 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 21263 1262 0 0 2428 3 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=455904 CPUtime=24.3 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 23697 1262 0 0 2426 4 0 0 25 0 9 0 591016814 466845696 77133 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364404 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 195.56
Current children cumulated vsize (KiB) 455904

[startup+51.1012 s]
/proc/loadavg: 7.76 7.92 7.60 9/179 19291
/proc/meminfo: memFree=17294292/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=454572 CPUtime=400.24 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 211017 1262 0 0 39989 35 0 0 18 0 9 0 591016696 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 113643 76800 181 55 0 111529 0
[pid=19276/tid=19283] ppid=19274 vsize=454572 CPUtime=49.92 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 21793 1262 0 0 4989 3 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=454572 CPUtime=49.9 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 18682 1262 0 0 4987 3 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=454572 CPUtime=49.9 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 23655 1262 0 0 4986 4 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4287492 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=454572 CPUtime=49.92 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 6193 1262 0 0 4991 1 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4245664 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=454572 CPUtime=49.65 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 19119 1262 0 0 4962 3 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4365897 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=454572 CPUtime=49.9 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 21540 1262 0 0 4987 3 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4365429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=454572 CPUtime=49.91 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 21325 1262 0 0 4988 3 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4262481 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=454572 CPUtime=49.9 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 23975 1262 0 0 4986 4 0 0 25 0 9 0 591016814 465481728 76800 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 400.24
Current children cumulated vsize (KiB) 454572

[startup+102.306 s]
/proc/loadavg: 7.95 7.94 7.63 9/179 19293

################
# More data... #
################

/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 94557 37 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1160012 CPUtime=945.84 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 149218 1262 0 0 94557 27 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4356864 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1160012 CPUtime=945.93 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 94570 23 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1160012 CPUtime=945.12 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 58232 1262 0 0 94501 11 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1160012 CPUtime=940.79 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 94061 18 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1160012 CPUtime=945.9 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 166006 1262 0 0 94560 30 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1160012 CPUtime=945.93 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 94576 17 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1160012 CPUtime=945.93 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 235295 1262 0 0 94550 43 0 0 25 0 9 0 591016814 1187852288 255247 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7562.62
Current children cumulated vsize (KiB) 1160012

[startup+959.901 s]
/proc/loadavg: 8.13 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16576084/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1174080 CPUtime=7664.91 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1181960 1262 0 0 766272 219 0 0 18 0 9 0 591016696 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 293520 258764 181 55 0 291406 0
[pid=19276/tid=19283] ppid=19274 vsize=1174080 CPUtime=958.73 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 95836 37 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1174080 CPUtime=958.64 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 150498 1262 0 0 95836 28 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1174080 CPUtime=958.72 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 95849 23 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1174080 CPUtime=957.91 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 58232 1262 0 0 95780 11 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1174080 CPUtime=953.52 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95334 18 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1174080 CPUtime=958.7 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 95839 31 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1174080 CPUtime=958.73 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 95856 17 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1174080 CPUtime=958.72 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 235295 1262 0 0 95829 43 0 0 25 0 9 0 591016814 1202257920 258764 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7664.91
Current children cumulated vsize (KiB) 1174080

[startup+963.101 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16542852/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1198380 CPUtime=7690.49 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1188035 1262 0 0 768829 220 0 0 18 0 9 0 591016696 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 299595 264839 181 55 0 297481 0
[pid=19276/tid=19283] ppid=19274 vsize=1198380 CPUtime=961.93 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 96156 37 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1198380 CPUtime=961.84 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 150498 1262 0 0 96156 28 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1198380 CPUtime=961.92 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 96169 23 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1198380 CPUtime=961.12 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 59064 1262 0 0 96100 12 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236735 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1198380 CPUtime=956.7 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95652 18 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1198380 CPUtime=961.9 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 96159 31 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1198380 CPUtime=961.93 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 96176 17 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1198380 CPUtime=961.92 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 240538 1262 0 0 96149 43 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7690.49
Current children cumulated vsize (KiB) 1198380

[startup+964.706 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16542852/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1198380 CPUtime=7703.32 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1188035 1262 0 0 770112 220 0 0 18 0 9 0 591016696 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 299595 264839 181 55 0 297481 0
[pid=19276/tid=19283] ppid=19274 vsize=1198380 CPUtime=963.54 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 96317 37 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1198380 CPUtime=963.44 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 150498 1262 0 0 96316 28 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1198380 CPUtime=963.53 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 96330 23 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1198380 CPUtime=962.73 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 59064 1262 0 0 96261 12 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1198380 CPUtime=958.29 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95811 18 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1198380 CPUtime=963.5 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 96319 31 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1198380 CPUtime=963.53 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 96336 17 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1198380 CPUtime=963.53 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 240538 1262 0 0 96310 43 0 0 25 0 9 0 591016814 1227141120 264839 33554432000 4194304 4417332 140736103568976 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7703.32
Current children cumulated vsize (KiB) 1198380

[startup+965.501 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16542852/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1172700 CPUtime=7709.68 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1190829 1262 0 0 770748 220 0 0 18 0 9 0 591016696 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 293175 258419 181 55 0 291061 0
[pid=19276/tid=19283] ppid=19274 vsize=1172700 CPUtime=964.33 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 96396 37 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1172700 CPUtime=964.23 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 153292 1262 0 0 96395 28 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1172700 CPUtime=964.32 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 96409 23 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1172700 CPUtime=963.52 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 59064 1262 0 0 96340 12 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1172700 CPUtime=959.09 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95891 18 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1172700 CPUtime=964.3 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 96399 31 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1172700 CPUtime=964.33 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 96416 17 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1172700 CPUtime=964.32 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 240538 1262 0 0 96389 43 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7709.68
Current children cumulated vsize (KiB) 1172700

[startup+965.901 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16568520/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1172700 CPUtime=7712.87 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1190829 1262 0 0 771067 220 0 0 18 0 9 0 591016696 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 293175 258419 181 55 0 291061 0
[pid=19276/tid=19283] ppid=19274 vsize=1172700 CPUtime=964.73 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 96436 37 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1172700 CPUtime=964.63 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 153292 1262 0 0 96435 28 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19285] ppid=19274 vsize=1172700 CPUtime=964.72 cores=0-7
/proc/19276/task/19285/stat : 19285 (plingeling) R 19274 19276 19046 0 -1 4202560 118280 1262 0 0 96449 23 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19276/tid=19286] ppid=19274 vsize=1172700 CPUtime=963.92 cores=0-7
/proc/19276/task/19286/stat : 19286 (plingeling) R 19274 19276 19046 0 -1 4202560 59064 1262 0 0 96380 12 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4265496 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1172700 CPUtime=959.48 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95930 18 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1172700 CPUtime=964.7 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 96439 31 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19276/tid=19289] ppid=19274 vsize=1172700 CPUtime=964.73 cores=0-7
/proc/19276/task/19289/stat : 19289 (plingeling) R 19274 19276 19046 0 -1 4202560 98011 1262 0 0 96456 17 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19276/tid=19290] ppid=19274 vsize=1172700 CPUtime=964.72 cores=0-7
/proc/19276/task/19290/stat : 19290 (plingeling) R 19274 19276 19046 0 -1 4202560 240538 1262 0 0 96429 43 0 0 25 0 9 0 591016814 1200844800 258419 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7712.87
Current children cumulated vsize (KiB) 1172700

[startup+966.101 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16568520/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1173032 CPUtime=7714.29 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1190913 1262 0 0 771209 220 0 0 18 0 5 0 591016696 1201184768 258503 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 293258 258503 182 55 0 291144 0
[pid=19276/tid=19283] ppid=19274 vsize=1173032 CPUtime=964.93 cores=0-7
/proc/19276/task/19283/stat : 19283 (plingeling) R 19274 19276 19046 0 -1 4202560 186903 1262 0 0 96456 37 0 0 25 0 5 0 591016814 1201184768 258503 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=1173032 CPUtime=964.83 cores=0-7
/proc/19276/task/19284/stat : 19284 (plingeling) R 19274 19276 19046 0 -1 4202560 153375 1262 0 0 96455 28 0 0 25 0 5 0 591016814 1201184768 258503 33554432000 4194304 4417332 140736103568976 18446744073709551615 4250505 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19276/tid=19287] ppid=19274 vsize=1173032 CPUtime=959.68 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95950 18 0 0 25 0 5 0 591016814 1201184768 258503 33554432000 4194304 4417332 140736103568976 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19276/tid=19288] ppid=19274 vsize=1173032 CPUtime=964.9 cores=0-7
/proc/19276/task/19288/stat : 19288 (plingeling) R 19274 19276 19046 0 -1 4202560 168243 1262 0 0 96459 31 0 0 25 0 5 0 591016814 1201184768 258503 33554432000 4194304 4417332 140736103568976 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7714.29
Current children cumulated vsize (KiB) 1173032

[startup+966.201 s]
/proc/loadavg: 8.12 8.06 7.86 9/179 19319
/proc/meminfo: memFree=16568520/32950940 swapFree=67111528/67111528
[pid=19276] ppid=19274 vsize=1162788 CPUtime=7714.51 cores=0-7
/proc/19276/stat : 19276 (plingeling) S 19274 19276 19046 0 -1 4202496 1190913 1262 0 0 771231 220 0 0 18 0 2 0 591016696 1190694912 258495 33554432000 4194304 4417332 140736103568976 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19276/statm: 290697 258495 182 55 0 288583 0
[pid=19276/tid=19287] ppid=19274 vsize=1162788 CPUtime=959.78 cores=0-7
/proc/19276/task/19287/stat : 19287 (plingeling) R 19274 19276 19046 0 -1 4202560 111763 1262 0 0 95960 18 0 0 25 0 2 0 591016814 1190694912 258495 33554432000 4194304 4417332 140736103568976 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 7714.51
Current children cumulated vsize (KiB) 1162788

Child status: 20
Real time (s): 966.261
CPU time (s): 7714.59
CPU user time (s): 7712.32
CPU system time (s): 2.26666
CPU usage (%): 798.396
Max. virtual memory (cumulated for all children) (KiB): 1315680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 7712.32
system time used= 2.26666
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1192178
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 636
involuntary context switches= 37128

runsolver used 1.59076 second user time and 3.67644 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-28 18:24:19
IDJOB=3309699
IDBENCH=82468
IDSOLVER=1695
FILE ID=node117/3309699-1304007859
RUNJOBID= node117-1304005129-19060
PBS_JOBID= 13168821
Free space on /tmp= 71672 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309699-1304007859/watcher-3309699-1304007859 -o /tmp/evaluation-result-3309699-1304007859/solver-3309699-1304007859 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309699-1304007859.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a0ec1baa890da62d0c6df7f1e62c6af3
RANDOM SEED=554271735

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      17601652 kB
Buffers:       2374328 kB
Cached:       12326556 kB
SwapCached:          0 kB
Active:        8058012 kB
Inactive:      6709776 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      17601652 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            8564 kB
Writeback:           0 kB
AnonPages:       66376 kB
Mapped:          14908 kB
Slab:           516964 kB
PageTables:       4388 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   187380 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71672 MiB
End job on node117 at 2011-04-28 18:40:26