Trace number 3371276

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.13 1202.83

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.11.unsat.cnf
MD5SUM90581094793af5fc10d4e4b9a10259ac
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark643.759
Satisfiable
(Un)Satisfiability was proved
Number of variables1400
Number of clauses4732
Sum of the clauses size12300
Maximum clause length21
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22052
Number of clauses of size 32605
Number of clauses of size 427
Number of clauses of size 531
Number of clauses of size over 514

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371276-1305416883/watcher-3371276-1305416883 -o /tmp/evaluation-result-3371276-1305416883/solver-3371276-1305416883 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371276-1305416883.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.81 7.82 7.98 2/288 28560
/proc/meminfo: memFree=24427744/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 214 0 0 0 0 0 0 0 22 0 1 0 634104214 8937472 145 33554432000 4194304 4417452 140733248832320 18446744073709551615 220816236288 0 0 4096 0 18446744071562362840 0 0 17 4 0 0 0
/proc/28560/statm: 2182 145 122 55 0 68 0

[startup+0.0286069 s]
/proc/loadavg: 6.81 7.82 7.98 2/288 28560
/proc/meminfo: memFree=24427744/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=9452 CPUtime=0 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) R 28558 28560 28032 0 -1 4202496 423 1251 0 2 0 0 0 0 22 0 1 0 634104214 9678848 353 33554432000 4194304 4417452 140733248832320 18446744073709551615 220815855227 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/28560/statm: 2363 353 148 55 0 249 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9452

[startup+0.100573 s]
/proc/loadavg: 6.81 7.82 7.98 2/288 28560
/proc/meminfo: memFree=24427744/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=51996 CPUtime=0.27 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 902 1251 0 2 27 0 0 0 22 0 5 0 634104214 53243904 828 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 12999 828 179 55 0 10885 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 51996

[startup+0.300524 s]
/proc/loadavg: 6.81 7.82 7.98 2/288 28560
/proc/meminfo: memFree=24427744/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=54564 CPUtime=1.07 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 1800 1251 0 2 107 0 0 0 22 0 5 0 634104214 55873536 1467 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 13641 1467 180 55 0 11527 0
Current children cumulated CPU time (s) 1.07
Current children cumulated vsize (KiB) 54564

[startup+0.70042 s]
/proc/loadavg: 6.81 7.82 7.98 2/288 28560
/proc/meminfo: memFree=24427744/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=55904 CPUtime=2.66 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 3124 1251 0 2 266 0 0 0 22 0 5 0 634104214 57245696 1799 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 13976 1799 180 55 0 11862 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 55904

[startup+1.50027 s]
/proc/loadavg: 6.81 7.82 7.98 10/300 28585
/proc/meminfo: memFree=24367892/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=57052 CPUtime=5.85 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 5944 1251 0 2 585 0 0 0 22 0 5 0 634104214 58421248 2093 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 14263 2093 180 55 0 12149 0
[pid=28560/tid=28567] ppid=28558 vsize=57052 CPUtime=1.46 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 1387 1251 0 2 146 0 0 0 25 0 5 0 634104217 58421248 2093 33554432000 4194304 4417452 140733248832320 18446744073709551615 4251045 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=57052 CPUtime=1.45 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 1109 1251 0 2 145 0 0 0 25 0 5 0 634104217 58421248 2093 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=57052 CPUtime=1.46 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 1322 1251 0 2 146 0 0 0 20 0 5 0 634104217 58421248 2093 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364437 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=57052 CPUtime=1.46 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 1561 1251 0 2 146 0 0 0 25 0 5 0 634104217 58421248 2093 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365120 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 57052

[startup+3.10098 s]
/proc/loadavg: 6.81 7.82 7.98 9/300 28585
/proc/meminfo: memFree=24352688/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=60088 CPUtime=12.25 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 10474 1251 0 2 1224 1 0 0 22 0 5 0 634104214 61530112 2831 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 15022 2831 180 55 0 12908 0
[pid=28560/tid=28567] ppid=28558 vsize=60088 CPUtime=3.06 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 2739 1251 0 2 306 0 0 0 25 0 5 0 634104217 61530112 2831 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365939 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=60088 CPUtime=3.04 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 2071 1251 0 2 304 0 0 0 25 0 5 0 634104217 61530112 2831 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=60088 CPUtime=3.06 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 2428 1251 0 2 306 0 0 0 25 0 5 0 634104217 61530112 2831 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=60088 CPUtime=3.06 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 2671 1251 0 2 306 0 0 0 25 0 5 0 634104217 61530112 2831 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.25
Current children cumulated vsize (KiB) 60088

[startup+6.30039 s]
/proc/loadavg: 6.90 7.82 7.98 9/300 28585
/proc/meminfo: memFree=24341904/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=62944 CPUtime=25.02 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 18291 1251 0 2 2499 3 0 0 22 0 5 0 634104214 64454656 3572 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 15736 3572 180 55 0 13622 0
[pid=28560/tid=28567] ppid=28558 vsize=62944 CPUtime=6.26 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 4560 1251 0 2 626 0 0 0 25 0 5 0 634104217 64454656 3572 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=62944 CPUtime=6.21 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 4173 1251 0 2 621 0 0 0 25 0 5 0 634104217 64454656 3572 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366402 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=62944 CPUtime=6.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 4410 1251 0 2 625 0 0 0 25 0 5 0 634104217 64454656 3572 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=62944 CPUtime=6.25 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 4583 1251 0 2 625 0 0 0 25 0 5 0 634104217 64454656 3572 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365135 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 62944

[startup+12.7002 s]
/proc/loadavg: 6.99 7.83 7.98 9/300 28585
/proc/meminfo: memFree=24335324/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=70008 CPUtime=50.56 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 34033 1251 0 2 5050 6 0 0 22 0 5 0 634104214 71688192 5310 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 17502 5310 180 55 0 15388 0
[pid=28560/tid=28567] ppid=28558 vsize=70008 CPUtime=12.66 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 8421 1251 0 2 1265 1 0 0 25 0 5 0 634104217 71688192 5310 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=70008 CPUtime=12.55 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 8506 1251 0 2 1254 1 0 0 25 0 5 0 634104217 71688192 5310 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=70008 CPUtime=12.66 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 8743 1251 0 2 1264 2 0 0 25 0 5 0 634104217 71688192 5310 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=70008 CPUtime=12.66 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 7798 1251 0 2 1265 1 0 0 25 0 5 0 634104217 71688192 5310 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.56
Current children cumulated vsize (KiB) 70008

[startup+25.5009 s]
/proc/loadavg: 7.21 7.83 7.98 9/300 28622
/proc/meminfo: memFree=24043428/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=73348 CPUtime=101.64 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 54602 1251 0 2 10155 9 0 0 22 0 5 0 634104214 75108352 6173 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 18337 6173 180 55 0 16223 0
[pid=28560/tid=28567] ppid=28558 vsize=73348 CPUtime=25.46 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 13087 1251 0 2 2544 2 0 0 25 0 5 0 634104217 75108352 6173 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=73348 CPUtime=25.23 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 13581 1251 0 2 2521 2 0 0 25 0 5 0 634104217 75108352 6173 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=73348 CPUtime=25.45 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 14236 1251 0 2 2543 2 0 0 25 0 5 0 634104217 75108352 6173 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=73348 CPUtime=25.46 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 13133 1251 0 2 2545 1 0 0 25 0 5 0 634104217 75108352 6173 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366126 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.64
Current children cumulated vsize (KiB) 73348

[startup+51.1011 s]
/proc/loadavg: 7.63 7.88 7.99 9/300 28622
/proc/meminfo: memFree=24102824/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=86872 CPUtime=203.81 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 98600 1251 0 2 20365 16 0 0 22 0 5 0 634104214 88956928 9554 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 21718 9554 180 55 0 19604 0
[pid=28560/tid=28567] ppid=28558 vsize=86872 CPUtime=51.06 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 24577 1251 0 2 5103 3 0 0 25 0 5 0 634104217 88956928 9554 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=86872 CPUtime=50.6 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 26192 1251 0 2 5056 4 0 0 25 0 5 0 634104217 88956928 9554 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=86872 CPUtime=51.06 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 25258 1251 0 2 5102 4 0 0 25 0 5 0 634104217 88956928 9554 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=86872 CPUtime=51.05 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 22008 1251 0 2 5102 3 0 0 25 0 5 0 634104217 88956928 9554 33554432000 4194304 4417452 140733248832320 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.81
Current children cumulated vsize (KiB) 86872

[startup+102.311 s]
/proc/loadavg: 7.90 7.91 8.00 9/300 28660
/proc/meminfo: memFree=24366136/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=92940 CPUtime=408.17 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 161416 1251 0 2 40791 26 0 0 22 0 5 0 634104214 95170560 11071 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 23235 11071 180 55 0 21121 0
[pid=28560/tid=28567] ppid=28558 vsize=92940 CPUtime=102.26 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 40345 1251 0 2 10221 5 0 0 25 0 5 0 634104217 95170560 11071 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=92940 CPUtime=101.34 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 40593 1251 0 2 10128 6 0 0 25 0 5 0 634104217 95170560 11071 33554432000 4194304 4417452 140733248832320 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=92940 CPUtime=102.26 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 41921 1251 0 2 10220 6 0 0 25 0 5 0 634104217 95170560 11071 33554432000 4194304 4417452 140733248832320 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=92940 CPUtime=102.26 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 37992 1251 0 2 10220 6 0 0 25 0 5 0 634104217 95170560 11071 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.17
Current children cumulated vsize (KiB) 92940

[startup+162.301 s]
/proc/loadavg: 8.02 7.94 8.00 9/300 28661
/proc/meminfo: memFree=24338220/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=117356 CPUtime=647.58 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 229150 1251 0 2 64721 37 0 0 22 0 5 0 634104214 120172544 17148 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 29339 17148 180 55 0 27225 0
[pid=28560/tid=28567] ppid=28558 vsize=117356 CPUtime=162.26 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 57917 1251 0 2 16218 8 0 0 25 0 5 0 634104217 120172544 17148 33554432000 4194304 4417452 140733248832320 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=117356 CPUtime=160.79 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 55475 1251 0 2 16070 9 0 0 25 0 5 0 634104217 120172544 17148 33554432000 4194304 4417452 140733248832320 18446744073709551615 4356075 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=117356 CPUtime=162.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 61285 1251 0 2 16216 9 0 0 25 0 5 0 634104217 120172544 17148 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=117356 CPUtime=162.24 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 53908 1251 0 2 16215 9 0 0 25 0 5 0 634104217 120172544 17148 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.58
Current children cumulated vsize (KiB) 117356


################
# More data... #
################

[pid=28560/tid=28568] ppid=28558 vsize=238364 CPUtime=695.9 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 140720 1251 0 2 69567 23 0 0 25 0 5 0 634104217 244084736 47395 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=238364 CPUtime=702.26 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 150309 1251 0 2 70203 23 0 0 25 0 5 0 634104217 244084736 47395 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=238364 CPUtime=702.17 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 162945 1251 0 2 70194 23 0 0 25 0 5 0 634104217 244084736 47395 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2802.65
Current children cumulated vsize (KiB) 238364

[startup+762.311 s]
/proc/loadavg: 8.12 8.07 8.01 9/300 28677
/proc/meminfo: memFree=24109956/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=304680 CPUtime=3042.13 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 660187 1251 0 2 304110 103 0 0 22 0 5 0 634104214 311992320 64006 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 76170 64006 180 55 0 74056 0
[pid=28560/tid=28567] ppid=28558 vsize=304680 CPUtime=762.29 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 158903 1251 0 2 76204 25 0 0 25 0 5 0 634104217 311992320 64006 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=304680 CPUtime=755.37 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 154614 1251 0 2 75511 26 0 0 25 0 5 0 634104217 311992320 64006 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=304680 CPUtime=762.26 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 173456 1251 0 2 76201 25 0 0 25 0 5 0 634104217 311992320 64006 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=304680 CPUtime=762.18 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 172649 1251 0 2 76193 25 0 0 25 0 5 0 634104217 311992320 64006 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3042.13
Current children cumulated vsize (KiB) 304680

[startup+822.301 s]
/proc/loadavg: 8.11 8.07 8.01 9/300 28688
/proc/meminfo: memFree=24098736/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=319328 CPUtime=3281.54 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 673642 1251 0 2 328049 105 0 0 22 0 5 0 634104214 326991872 67635 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 79832 67635 180 55 0 77718 0
[pid=28560/tid=28567] ppid=28558 vsize=319328 CPUtime=822.27 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 158903 1251 0 2 82202 25 0 0 25 0 5 0 634104217 326991872 67635 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=319328 CPUtime=814.81 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 157217 1251 0 2 81455 26 0 0 25 0 5 0 634104217 326991872 67635 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=319328 CPUtime=822.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 173757 1251 0 2 82200 25 0 0 25 0 5 0 634104217 326991872 67635 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=319328 CPUtime=822.16 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 183200 1251 0 2 82190 26 0 0 25 0 5 0 634104217 326991872 67635 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3281.54
Current children cumulated vsize (KiB) 319328

[startup+882.301 s]
/proc/loadavg: 8.04 8.05 8.00 10/300 28689
/proc/meminfo: memFree=24125624/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=278980 CPUtime=3520.99 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 695961 1251 0 2 351991 108 0 0 22 0 5 0 634104214 285675520 57549 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 69745 57549 180 55 0 67631 0
[pid=28560/tid=28567] ppid=28558 vsize=278980 CPUtime=882.28 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 167294 1251 0 2 88202 26 0 0 25 0 5 0 634104217 285675520 57549 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=278980 CPUtime=874.27 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 161940 1251 0 2 87400 27 0 0 25 0 5 0 634104217 285675520 57549 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=278980 CPUtime=882.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 173757 1251 0 2 88200 25 0 0 25 0 5 0 634104217 285675520 57549 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=278980 CPUtime=882.16 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 192405 1251 0 2 88188 28 0 0 25 0 5 0 634104217 285675520 57549 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3520.99
Current children cumulated vsize (KiB) 278980

[startup+942.301 s]
/proc/loadavg: 8.09 8.06 8.00 9/300 28691
/proc/meminfo: memFree=24108732/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=298096 CPUtime=3760.44 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 722782 1251 0 2 375933 111 0 0 22 0 5 0 634104214 305250304 62328 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 74524 62328 180 55 0 72410 0
[pid=28560/tid=28567] ppid=28558 vsize=298096 CPUtime=942.28 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 170215 1251 0 2 94201 27 0 0 25 0 5 0 634104217 305250304 62328 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=298096 CPUtime=933.73 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 163554 1251 0 2 93346 27 0 0 25 0 5 0 634104217 305250304 62328 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=298096 CPUtime=942.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 185408 1251 0 2 94198 27 0 0 25 0 5 0 634104217 305250304 62328 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=298096 CPUtime=942.14 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 203040 1251 0 2 94186 28 0 0 25 0 5 0 634104217 305250304 62328 33554432000 4194304 4417452 140733248832320 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3760.44
Current children cumulated vsize (KiB) 298096

[startup+1002.3 s]
/proc/loadavg: 8.10 8.06 8.00 9/300 28693
/proc/meminfo: memFree=24091596/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=307336 CPUtime=3999.89 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 736074 1251 0 2 399876 113 0 0 22 0 5 0 634104214 314712064 64637 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 76834 64637 180 55 0 74720 0
[pid=28560/tid=28567] ppid=28558 vsize=307336 CPUtime=1002.29 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 170532 1251 0 2 100202 27 0 0 25 0 5 0 634104217 314712064 64637 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=307336 CPUtime=993.18 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 167416 1251 0 2 99291 27 0 0 25 0 5 0 634104217 314712064 64637 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=307336 CPUtime=1002.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 188093 1251 0 2 100198 27 0 0 25 0 5 0 634104217 314712064 64637 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365111 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=307336 CPUtime=1002.13 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 209468 1251 0 2 100184 29 0 0 25 0 5 0 634104217 314712064 64637 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3999.89
Current children cumulated vsize (KiB) 307336

[startup+1062.3 s]
/proc/loadavg: 8.15 8.08 8.01 9/300 28694
/proc/meminfo: memFree=24106456/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=294256 CPUtime=4239.35 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 756614 1251 0 2 423819 116 0 0 22 0 5 0 634104214 301318144 61368 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 73564 61368 180 55 0 71450 0
[pid=28560/tid=28567] ppid=28558 vsize=294256 CPUtime=1062.29 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 170532 1251 0 2 106202 27 0 0 25 0 5 0 634104217 301318144 61368 33554432000 4194304 4417452 140733248832320 18446744073709551615 4365062 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=294256 CPUtime=1052.65 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 179735 1251 0 2 105235 30 0 0 25 0 5 0 634104217 301318144 61368 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=294256 CPUtime=1062.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 188093 1251 0 2 106198 27 0 0 25 0 5 0 634104217 301318144 61368 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=294256 CPUtime=1062.13 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 217689 1251 0 2 106182 31 0 0 25 0 5 0 634104217 301318144 61368 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4239.35
Current children cumulated vsize (KiB) 294256

[startup+1122.3 s]
/proc/loadavg: 8.16 8.09 8.01 9/300 28696
/proc/meminfo: memFree=24045180/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=346884 CPUtime=4478.79 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 776492 1251 0 2 447759 120 0 0 22 0 5 0 634104214 355209216 74525 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 86721 74525 180 55 0 84607 0
[pid=28560/tid=28567] ppid=28558 vsize=346884 CPUtime=1122.29 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 176058 1251 0 2 112201 28 0 0 25 0 5 0 634104217 355209216 74525 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=346884 CPUtime=1112.09 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 185281 1251 0 2 111179 30 0 0 25 0 5 0 634104217 355209216 74525 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=346884 CPUtime=1122.25 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 188351 1251 0 2 112197 28 0 0 25 0 5 0 634104217 355209216 74525 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=346884 CPUtime=1122.12 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 226237 1251 0 2 112180 32 0 0 25 0 5 0 634104217 355209216 74525 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4478.79
Current children cumulated vsize (KiB) 346884

[startup+1182.3 s]
/proc/loadavg: 8.11 8.09 8.01 9/300 28697
/proc/meminfo: memFree=24012176/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=384780 CPUtime=4718.25 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 797718 1251 0 2 471702 123 0 0 22 0 5 0 634104214 394014720 83999 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 96195 83999 180 55 0 94081 0
[pid=28560/tid=28567] ppid=28558 vsize=384780 CPUtime=1182.29 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 182135 1251 0 2 118200 29 0 0 25 0 5 0 634104217 394014720 83999 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=384780 CPUtime=1171.55 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 187766 1251 0 2 117125 30 0 0 25 0 5 0 634104217 394014720 83999 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=384780 CPUtime=1182.26 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 193463 1251 0 2 118197 29 0 0 25 0 5 0 634104217 394014720 83999 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=384780 CPUtime=1182.12 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 233789 1251 0 2 118179 33 0 0 25 0 5 0 634104217 394014720 83999 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4718.25
Current children cumulated vsize (KiB) 384780



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.08 8.08 8.01 9/300 28698
/proc/meminfo: memFree=23988364/32951124 swapFree=63485424/67111528
[pid=28560] ppid=28558 vsize=403732 CPUtime=4800.08 cores=0,2,4,6
/proc/28560/stat : 28560 (plingeling) S 28558 28560 28032 0 -1 4202496 806613 1251 0 2 479884 124 0 0 22 0 5 0 634104214 413421568 88737 33554432000 4194304 4417452 140733248832320 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/28560/statm: 100933 88737 180 55 0 98819 0
[pid=28560/tid=28567] ppid=28558 vsize=403732 CPUtime=1202.8 cores=0,2,4,6
/proc/28560/task/28567/stat : 28567 (plingeling) R 28558 28560 28032 0 -1 4202560 182135 1251 0 2 120251 29 0 0 25 0 5 0 634104217 413421568 88737 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=28560/tid=28568] ppid=28558 vsize=403732 CPUtime=1191.87 cores=0,2,4,6
/proc/28560/task/28568/stat : 28568 (plingeling) R 28558 28560 28032 0 -1 4202560 188376 1251 0 2 119157 30 0 0 25 0 5 0 634104217 413421568 88737 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28560/tid=28569] ppid=28558 vsize=403732 CPUtime=1202.76 cores=0,2,4,6
/proc/28560/task/28569/stat : 28569 (plingeling) R 28558 28560 28032 0 -1 4202560 199213 1251 0 2 120246 30 0 0 25 0 5 0 634104217 413421568 88737 33554432000 4194304 4417452 140733248832320 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28560/tid=28570] ppid=28558 vsize=403732 CPUtime=1202.62 cores=0,2,4,6
/proc/28560/task/28570/stat : 28570 (plingeling) R 28558 28560 28032 0 -1 4202560 236324 1251 0 2 120229 33 0 0 25 0 5 0 634104217 413421568 88737 33554432000 4194304 4417452 140733248832320 18446744073709551615 4357213 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 403732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.83
CPU time (s): 4800.13
CPU user time (s): 4798.87
CPU system time (s): 1.26481
CPU usage (%): 399.069
Max. virtual memory (cumulated for all children) (KiB): 412032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.87
system time used= 1.26481
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 807864
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 94
involuntary context switches= 24240

runsolver used 3.09053 second user time and 7.85881 second system time

The end

Launcher Data 

Begin job on node147 at 2011-05-15 01:48:03
IDJOB=3371276
IDBENCH=20472
IDSOLVER=1848
FILE ID=node147/3371276-1305416883
RUNJOBID= node147-1305416883-28546
PBS_JOBID= 13324515
Free space on /tmp= 73108 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.11.unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371276-1305416883/watcher-3371276-1305416883 -o /tmp/evaluation-result-3371276-1305416883/solver-3371276-1305416883 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371276-1305416883.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 90581094793af5fc10d4e4b9a10259ac
RANDOM SEED=2096444229

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24428148 kB
Buffers:        292380 kB
Cached:        4966404 kB
SwapCached:      13132 kB
Active:        1630564 kB
Inactive:      6659460 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24428148 kB
SwapTotal:    67111528 kB
SwapFree:     63485424 kB
Dirty:             552 kB
Writeback:           0 kB
AnonPages:     3026492 kB
Mapped:          14440 kB
Slab:           140924 kB
PageTables:      28648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 44829940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73108 MiB
End job on node147 at 2011-05-15 02:08:08