Trace number 3372224

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5004.73

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitsrotate/
countbitsrotate032.cnf
MD5SUM8d76aa747359ea8ccf15726792949452
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables8527
Number of clauses25484
Sum of the clauses size59460
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 216988
Number of clauses of size 38494
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372224-1305436692/watcher-3372224-1305436692 -o /tmp/evaluation-result-3372224-1305436692/solver-3372224-1305436692 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372224-1305436692.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=9444 CPUtime=0 cores=0-7
/proc/18251/stat : 18251 (plingeling) R 18249 18251 18058 0 -1 4202496 447 1250 0 0 0 0 0 0 18 0 1 0 655269944 9670656 376 33554432000 4194304 4417452 140733600170640 18446744073709551615 4262092 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/18251/statm: 2361 376 148 55 0 247 0

[startup+0.440952 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=237224 CPUtime=3.09 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 9328 1250 0 0 308 1 0 0 18 0 9 0 655269944 242917376 4017 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 59006 3816 175 55 0 56892 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 237224

[startup+0.532336 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=241928 CPUtime=6.05 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 11589 1250 0 0 604 1 0 0 18 0 9 0 655269944 247734272 5360 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60482 5360 179 55 0 58368 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 241928

[startup+0.913659 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=241928 CPUtime=6.85 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 11589 1250 0 0 684 1 0 0 18 0 9 0 655269944 247734272 5360 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60482 5360 179 55 0 58368 0
Current children cumulated CPU time (s) 6.85
Current children cumulated vsize (KiB) 241928

[startup+1.01364 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=241928 CPUtime=7.65 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 11589 1250 0 0 764 1 0 0 18 0 9 0 655269944 247734272 5360 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60482 5360 179 55 0 58368 0
Current children cumulated CPU time (s) 7.65
Current children cumulated vsize (KiB) 241928

[startup+1.50055 s]
/proc/loadavg: 7.44 7.85 7.10 1/231 18251
/proc/meminfo: memFree=24203156/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=243976 CPUtime=11.54 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 12869 1250 0 0 1153 1 0 0 18 0 9 0 655269944 249831424 5872 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60994 5872 179 55 0 58880 0
Current children cumulated CPU time (s) 11.54
Current children cumulated vsize (KiB) 243976

[startup+3.10026 s]
/proc/loadavg: 7.44 7.85 7.10 9/240 18265
/proc/meminfo: memFree=24177912/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=242488 CPUtime=24.32 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 13113 1250 0 0 2431 1 0 0 18 0 9 0 655269944 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60622 5501 180 55 0 58508 0
[pid=18251/tid=18258] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 1876 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251076 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 993 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352515 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 1055 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352428 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 268 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4355835 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 1658 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352640 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=242488 CPUtime=3.03 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 1187 1250 0 0 303 0 0 0 25 0 9 0 655269950 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=242488 CPUtime=3.01 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 1158 1250 0 0 301 0 0 0 25 0 9 0 655269951 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=242488 CPUtime=3.02 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 1173 1250 0 0 302 0 0 0 25 0 9 0 655269951 248307712 5501 33554432000 4194304 4417452 140733600170640 18446744073709551615 4353533 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.32
Current children cumulated vsize (KiB) 242488

[startup+6.30067 s]
/proc/loadavg: 7.48 7.86 7.11 9/240 18265
/proc/meminfo: memFree=24177796/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=243816 CPUtime=49.9 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 13445 1250 0 0 4989 1 0 0 18 0 9 0 655269944 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 60954 5833 180 55 0 58840 0
[pid=18251/tid=18258] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 1889 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 993 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365191 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 1055 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 285 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 1721 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 1243 1250 0 0 623 0 0 0 25 0 9 0 655269950 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4357048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=243816 CPUtime=6.19 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 1158 1250 0 0 619 0 0 0 25 0 9 0 655269951 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=243816 CPUtime=6.23 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 1356 1250 0 0 623 0 0 0 25 0 9 0 655269951 249667584 5833 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.9
Current children cumulated vsize (KiB) 243816

[startup+12.7005 s]
/proc/loadavg: 7.53 7.86 7.11 9/240 18265
/proc/meminfo: memFree=24177432/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=245012 CPUtime=101.1 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 15419 1250 0 0 10109 1 0 0 18 0 9 0 655269944 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 61253 6132 180 55 0 59139 0
[pid=18251/tid=18258] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 2384 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4237332 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 993 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4354070 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 1126 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236613 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 285 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 2393 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=245012 CPUtime=12.64 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 1243 1250 0 0 1264 0 0 0 25 0 9 0 655269950 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4366005 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=245012 CPUtime=12.55 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 1158 1250 0 0 1255 0 0 0 25 0 9 0 655269951 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364474 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=245012 CPUtime=12.63 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 2092 1250 0 0 1263 0 0 0 25 0 9 0 655269951 250892288 6132 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352428 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.1
Current children cumulated vsize (KiB) 245012

[startup+25.5012 s]
/proc/loadavg: 7.63 7.86 7.13 9/240 18266
/proc/meminfo: memFree=24174768/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=249956 CPUtime=203.37 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 21803 1250 0 0 20335 2 0 0 18 0 9 0 655269944 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 62489 7368 180 55 0 60375 0
[pid=18251/tid=18258] ppid=18249 vsize=249956 CPUtime=25.43 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 3804 1250 0 0 2543 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352385 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=249956 CPUtime=25.44 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 1060 1250 0 0 2544 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352409 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=249956 CPUtime=25.43 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 1700 1250 0 0 2543 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=249956 CPUtime=25.43 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 1355 1250 0 0 2543 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4354540 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=249956 CPUtime=25.43 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 3832 1250 0 0 2543 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=249956 CPUtime=25.43 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 1259 1250 0 0 2543 0 0 0 25 0 9 0 655269950 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=249956 CPUtime=25.25 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 1451 1250 0 0 2525 0 0 0 25 0 9 0 655269951 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4250980 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=249956 CPUtime=25.42 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 3597 1250 0 0 2542 0 0 0 25 0 9 0 655269951 255954944 7368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.37
Current children cumulated vsize (KiB) 249956

[startup+51.1005 s]
/proc/loadavg: 7.82 7.89 7.15 9/240 18266
/proc/meminfo: memFree=24168808/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=256532 CPUtime=407.98 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 36625 1250 0 0 40793 5 0 0 18 0 9 0 655269944 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 64133 9012 180 55 0 62019 0
[pid=18251/tid=18258] ppid=18249 vsize=256532 CPUtime=51.02 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 6709 1250 0 0 5102 0 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352333 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=256532 CPUtime=51.04 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 1516 1250 0 0 5104 0 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=256532 CPUtime=51.03 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 4687 1250 0 0 5102 1 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236935 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=256532 CPUtime=51.03 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 3019 1250 0 0 5103 0 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=256532 CPUtime=51.03 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 6744 1250 0 0 5102 1 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4250961 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=256532 CPUtime=51.03 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 1259 1250 0 0 5103 0 0 0 25 0 9 0 655269950 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4353526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=256532 CPUtime=50.67 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 3224 1250 0 0 5067 0 0 0 25 0 9 0 655269951 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=256532 CPUtime=51.02 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 5722 1250 0 0 5102 0 0 0 25 0 9 0 655269951 262688768 9012 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.98
Current children cumulated vsize (KiB) 256532

[startup+102.301 s]
/proc/loadavg: 7.99 7.92 7.20 9/240 18268

################
# More data... #
################

/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 288402 1250 0 0 466185 51 0 0 25 0 9 0 655269950 585592832 87879 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=571868 CPUtime=4662.37 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 546559 1250 0 0 466155 82 0 0 25 0 9 0 655269950 585592832 87879 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364495 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=571868 CPUtime=4662.37 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 203081 1250 0 0 466205 32 0 0 25 0 9 0 655269950 585592832 87879 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=571868 CPUtime=4628.31 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 527678 1250 0 0 462743 88 0 0 25 0 9 0 655269951 585592832 87879 33554432000 4194304 4417452 140733600170640 18446744073709551615 4250858 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=571868 CPUtime=4661.54 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 441438 1250 0 0 466079 75 0 0 25 0 9 0 655269951 585592832 87879 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365162 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37263.6
Current children cumulated vsize (KiB) 571868

[startup+4722.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/240 18403
/proc/meminfo: memFree=23848692/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=576660 CPUtime=37743.2 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3280623 1250 0 0 3773780 539 0 0 18 0 9 0 655269944 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 144165 89056 180 55 0 142051 0
[pid=18251/tid=18258] ppid=18249 vsize=576660 CPUtime=4722.37 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 447962 1250 0 0 472160 77 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=576660 CPUtime=4722.37 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 251084 1250 0 0 472199 38 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=576660 CPUtime=4721.81 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 552934 1250 0 0 472092 89 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=576660 CPUtime=4722.36 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 291304 1250 0 0 472185 51 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=576660 CPUtime=4722.37 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 550725 1250 0 0 472155 82 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=576660 CPUtime=4722.37 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 205376 1250 0 0 472205 32 0 0 25 0 9 0 655269950 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=576660 CPUtime=4687.88 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 531109 1250 0 0 468699 89 0 0 25 0 9 0 655269951 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=576660 CPUtime=4721.54 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 446384 1250 0 0 472078 76 0 0 25 0 9 0 655269951 590499840 89056 33554432000 4194304 4417452 140733600170640 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37743.2
Current children cumulated vsize (KiB) 576660

[startup+4782.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/240 18404
/proc/meminfo: memFree=23832100/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=592040 CPUtime=38222.8 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3309168 1250 0 0 3821738 542 0 0 18 0 9 0 655269944 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 148010 92901 180 55 0 145896 0
[pid=18251/tid=18258] ppid=18249 vsize=592040 CPUtime=4782.38 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 449765 1250 0 0 478161 77 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=592040 CPUtime=4782.38 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 254206 1250 0 0 478199 39 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4354082 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=592040 CPUtime=4781.81 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 557463 1250 0 0 478092 89 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=592040 CPUtime=4782.36 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 295504 1250 0 0 478185 51 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=592040 CPUtime=4782.38 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 553817 1250 0 0 478155 83 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=592040 CPUtime=4782.38 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 207696 1250 0 0 478205 33 0 0 25 0 9 0 655269950 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=592040 CPUtime=4747.45 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 535507 1250 0 0 474656 89 0 0 25 0 9 0 655269951 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=592040 CPUtime=4781.55 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 451465 1250 0 0 478078 77 0 0 25 0 9 0 655269951 606248960 92901 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38222.8
Current children cumulated vsize (KiB) 592040

[startup+4842.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/240 18406
/proc/meminfo: memFree=23848320/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=575616 CPUtime=38702.3 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3345798 1250 0 0 3869684 549 0 0 18 0 9 0 655269944 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 143904 88795 180 55 0 141790 0
[pid=18251/tid=18258] ppid=18249 vsize=575616 CPUtime=4842.37 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 454483 1250 0 0 484159 78 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236569 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=575616 CPUtime=4842.37 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 257347 1250 0 0 484198 39 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=575616 CPUtime=4841.8 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 561705 1250 0 0 484090 90 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4354150 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=575616 CPUtime=4842.36 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 298313 1250 0 0 484184 52 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=575616 CPUtime=4842.38 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 558521 1250 0 0 484154 84 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=575616 CPUtime=4842.37 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 210705 1250 0 0 484204 33 0 0 25 0 9 0 655269950 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=575616 CPUtime=4807.01 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 540388 1250 0 0 480611 90 0 0 25 0 9 0 655269951 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4354082 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=575616 CPUtime=4841.55 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 460591 1250 0 0 484076 79 0 0 25 0 9 0 655269951 589430784 88795 33554432000 4194304 4417452 140733600170640 18446744073709551615 4353536 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38702.3
Current children cumulated vsize (KiB) 575616

[startup+4902.31 s]
/proc/loadavg: 8.06 8.05 8.00 9/240 18408
/proc/meminfo: memFree=23817248/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=606952 CPUtime=39182 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3376226 1250 0 0 3917641 555 0 0 18 0 9 0 655269944 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 151738 96629 180 55 0 149624 0
[pid=18251/tid=18258] ppid=18249 vsize=606952 CPUtime=4902.39 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 458077 1250 0 0 490160 79 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=606952 CPUtime=4902.38 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 259741 1250 0 0 490199 39 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4366005 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=606952 CPUtime=4901.8 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 564290 1250 0 0 490090 90 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=606952 CPUtime=4902.37 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 305337 1250 0 0 490183 54 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4357540 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=606952 CPUtime=4902.39 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 562172 1250 0 0 490154 85 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4365118 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=606952 CPUtime=4902.38 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 212768 1250 0 0 490205 33 0 0 25 0 9 0 655269950 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251034 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=606952 CPUtime=4866.58 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 544371 1250 0 0 486567 91 0 0 25 0 9 0 655269951 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=606952 CPUtime=4901.55 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 465725 1250 0 0 490075 80 0 0 25 0 9 0 655269951 621518848 96629 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39182
Current children cumulated vsize (KiB) 606952

[startup+4962.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/240 18409
/proc/meminfo: memFree=23866684/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=556756 CPUtime=39661.5 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3406931 1250 0 0 3965588 560 0 0 18 0 9 0 655269944 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 139189 84080 180 55 0 137075 0
[pid=18251/tid=18258] ppid=18249 vsize=556756 CPUtime=4962.38 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 461541 1250 0 0 496159 79 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=556756 CPUtime=4962.38 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 262919 1250 0 0 496198 40 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=556756 CPUtime=4961.79 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 568503 1250 0 0 496088 91 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=556756 CPUtime=4962.37 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 309104 1250 0 0 496181 56 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=556756 CPUtime=4962.37 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 565923 1250 0 0 496152 85 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=556756 CPUtime=4962.38 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 215770 1250 0 0 496205 33 0 0 25 0 9 0 655269950 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4352402 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=556756 CPUtime=4926.13 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 549269 1250 0 0 492522 91 0 0 25 0 9 0 655269951 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=556756 CPUtime=4961.55 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 470157 1250 0 0 496074 81 0 0 25 0 9 0 655269951 570118144 84080 33554432000 4194304 4417452 140733600170640 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39661.5
Current children cumulated vsize (KiB) 556756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.7 s]
/proc/loadavg: 8.06 8.06 8.00 9/240 18410
/proc/meminfo: memFree=23834180/32951124 swapFree=61559568/67111528
[pid=18251] ppid=18249 vsize=589908 CPUtime=40000.4 cores=0-7
/proc/18251/stat : 18251 (plingeling) S 18249 18251 18058 0 -1 4202496 3423458 1250 0 0 3999477 563 0 0 18 0 9 0 655269944 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/18251/statm: 147477 92368 180 55 0 145363 0
[pid=18251/tid=18258] ppid=18249 vsize=589908 CPUtime=5004.79 cores=0-7
/proc/18251/task/18258/stat : 18258 (plingeling) R 18249 18251 18058 0 -1 4202560 461541 1250 0 0 500400 79 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18251/tid=18259] ppid=18249 vsize=589908 CPUtime=5004.78 cores=0-7
/proc/18251/task/18259/stat : 18259 (plingeling) R 18249 18251 18058 0 -1 4202560 265293 1250 0 0 500438 40 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4237250 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=18251/tid=18260] ppid=18249 vsize=589908 CPUtime=5004.19 cores=0-7
/proc/18251/task/18260/stat : 18260 (plingeling) R 18249 18251 18058 0 -1 4202560 571369 1250 0 0 500328 91 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18251/tid=18261] ppid=18249 vsize=589908 CPUtime=5004.78 cores=0-7
/proc/18251/task/18261/stat : 18261 (plingeling) R 18249 18251 18058 0 -1 4202560 309308 1250 0 0 500422 56 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4353727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18251/tid=18262] ppid=18249 vsize=589908 CPUtime=5004.79 cores=0-7
/proc/18251/task/18262/stat : 18262 (plingeling) R 18249 18251 18058 0 -1 4202560 569619 1250 0 0 500393 86 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4353661 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18251/tid=18263] ppid=18249 vsize=589908 CPUtime=5004.78 cores=0-7
/proc/18251/task/18263/stat : 18263 (plingeling) R 18249 18251 18058 0 -1 4202560 217012 1250 0 0 500445 33 0 0 25 0 9 0 655269950 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4251172 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18251/tid=18264] ppid=18249 vsize=589908 CPUtime=4968.23 cores=0-7
/proc/18251/task/18264/stat : 18264 (plingeling) R 18249 18251 18058 0 -1 4202560 552166 1250 0 0 496731 92 0 0 25 0 9 0 655269951 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18251/tid=18265] ppid=18249 vsize=589908 CPUtime=5003.95 cores=0-7
/proc/18251/task/18265/stat : 18265 (plingeling) R 18249 18251 18058 0 -1 4202560 473405 1250 0 0 500314 81 0 0 25 0 9 0 655269951 604065792 92368 33554432000 4194304 4417452 140733600170640 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 589908

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.73
CPU time (s): 40000.5
CPU user time (s): 39994.8
CPU system time (s): 5.66014
CPU usage (%): 799.253
Max. virtual memory (cumulated for all children) (KiB): 617868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39994.8
system time used= 5.66014
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3424708
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 357
involuntary context switches= 189722

runsolver used 10.7304 second user time and 25.6741 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-15 07:18:12
IDJOB=3372224
IDBENCH=70775
IDSOLVER=1851
FILE ID=node109/3372224-1305436692
RUNJOBID= node109-1305435362-18072
PBS_JOBID= 13324734
Free space on /tmp= 73276 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitsrotate/countbitsrotate032.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372224-1305436692/watcher-3372224-1305436692 -o /tmp/evaluation-result-3372224-1305436692/solver-3372224-1305436692 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372224-1305436692.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8d76aa747359ea8ccf15726792949452
RANDOM SEED=2108164606

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24203560 kB
Buffers:        260784 kB
Cached:        2332604 kB
SwapCached:      28404 kB
Active:         162492 kB
Inactive:      8363624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24203560 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:             456 kB
Writeback:           0 kB
AnonPages:     5911784 kB
Mapped:          17604 kB
Slab:           127584 kB
PageTables:      31008 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 17847780 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73272 MiB
End job on node109 at 2011-05-15 08:41:39