Trace number 3394880

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.4 5009.68

General information on the benchmark

NameSAT05/crafted/sorge05/QG7/
gensys-icl007.shuffled-as.sat05-3133.cnf
MD5SUM88361752c7b0c05e849791aafdd7bdba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark219.938
Satisfiable
(Un)Satisfiability was proved
Number of variables762
Number of clauses17262
Sum of the clauses size76511
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 21135
Number of clauses of size 38742
Number of clauses of size 4236
Number of clauses of size 5256
Number of clauses of size over 56851

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394880-1306108759/watcher-3394880-1306108759 -o /tmp/evaluation-result-3394880-1306108759/solver-3394880-1306108759 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394880-1306108759.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.62 6.85 6.93 2/448 6861
/proc/meminfo: memFree=14659268/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=9560 CPUtime=0 cores=0-7
/proc/6861/stat : 6861 (plingeling) R 6859 6861 6795 0 -1 4202496 475 1251 0 0 0 0 0 0 23 0 1 0 703291835 9789440 405 33554432000 4194304 4417452 140735443476576 18446744073709551615 220816236288 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/6861/statm: 2390 405 148 55 0 276 0

[startup+0.045756 s]
/proc/loadavg: 6.62 6.85 6.93 2/448 6861
/proc/meminfo: memFree=14659268/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=20128 CPUtime=0.03 cores=0-7
/proc/6861/stat : 6861 (plingeling) R 6859 6861 6795 0 -1 4202496 3142 1251 0 0 3 0 0 0 23 0 1 0 703291835 20611072 3056 33554432000 4194304 4417452 140735443476576 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/6861/statm: 5032 3056 149 55 0 2918 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 20128

[startup+0.166689 s]
/proc/loadavg: 6.62 6.85 6.93 2/448 6861
/proc/meminfo: memFree=14659268/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=167896 CPUtime=0.92 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 3381 1251 0 0 92 0 0 0 18 0 9 0 703291835 171925504 3187 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 41974 3187 180 55 0 39860 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 167896

[startup+0.359284 s]
/proc/loadavg: 6.62 6.85 6.93 2/448 6861
/proc/meminfo: memFree=14659268/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=169284 CPUtime=2.52 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 3872 1251 0 0 252 0 0 0 18 0 9 0 703291835 173346816 3514 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 42321 3514 180 55 0 40207 0
Current children cumulated CPU time (s) 2.52
Current children cumulated vsize (KiB) 169284

[startup+0.700592 s]
/proc/loadavg: 6.62 6.85 6.93 2/448 6861
/proc/meminfo: memFree=14659268/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=172952 CPUtime=5.19 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 6702 1251 0 0 519 0 0 0 18 0 9 0 703291835 177102848 4485 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 43238 4485 180 55 0 41124 0
Current children cumulated CPU time (s) 5.19
Current children cumulated vsize (KiB) 172952

[startup+1.50045 s]
/proc/loadavg: 6.62 6.85 6.93 9/457 6875
/proc/meminfo: memFree=14637116/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=178352 CPUtime=11.57 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 12907 1251 0 0 1155 2 0 0 18 0 9 0 703291835 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 44588 5850 180 55 0 42474 0
[pid=6861/tid=6868] ppid=6859 vsize=178352 CPUtime=1.41 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 1335 1251 0 0 141 0 0 0 25 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 1430 1251 0 0 144 0 0 0 25 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 771 1251 0 0 144 0 0 0 23 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 1630 1251 0 0 144 0 0 0 23 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 1060 1251 0 0 144 0 0 0 20 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 1284 1251 0 0 144 0 0 0 23 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=178352 CPUtime=1.44 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 830 1251 0 0 144 0 0 0 23 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=178352 CPUtime=1.42 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 1408 1251 0 0 142 0 0 0 23 0 9 0 703291840 182632448 5850 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364791 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 178352

[startup+3.10115 s]
/proc/loadavg: 6.62 6.85 6.93 9/457 6875
/proc/meminfo: memFree=14627384/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=187544 CPUtime=24.36 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 43027 1251 0 0 2429 7 0 0 18 0 9 0 703291835 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 46886 8148 180 55 0 44772 0
[pid=6861/tid=6868] ppid=6859 vsize=187544 CPUtime=3 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 4930 1251 0 0 300 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=187544 CPUtime=3.03 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 6586 1251 0 0 303 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4353870 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=187544 CPUtime=3.04 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 4026 1251 0 0 304 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=187544 CPUtime=3.04 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 3005 1251 0 0 304 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=187544 CPUtime=3.04 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 6279 1251 0 0 303 1 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=187544 CPUtime=3.03 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 5395 1251 0 0 303 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=187544 CPUtime=3.04 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 3486 1251 0 0 304 0 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=187544 CPUtime=3.01 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 6161 1251 0 0 300 1 0 0 25 0 9 0 703291840 192045056 8148 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.36
Current children cumulated vsize (KiB) 187544

[startup+6.30056 s]
/proc/loadavg: 6.73 6.87 6.93 9/457 6875
/proc/meminfo: memFree=14606972/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=211360 CPUtime=49.91 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 75911 1251 0 0 4978 13 0 0 18 0 9 0 703291835 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 52840 14105 180 55 0 50726 0
[pid=6861/tid=6868] ppid=6859 vsize=211360 CPUtime=6.2 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 9059 1251 0 0 619 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=211360 CPUtime=6.24 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 11222 1251 0 0 623 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=211360 CPUtime=6.25 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 8045 1251 0 0 624 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=211360 CPUtime=6.24 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 5705 1251 0 0 623 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=211360 CPUtime=6.23 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 10336 1251 0 0 622 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=211360 CPUtime=6.24 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 10642 1251 0 0 622 2 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4354469 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=211360 CPUtime=6.24 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 7750 1251 0 0 623 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=211360 CPUtime=6.16 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 9993 1251 0 0 615 1 0 0 25 0 9 0 703291840 216432640 14105 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366130 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.91
Current children cumulated vsize (KiB) 211360

[startup+12.7004 s]
/proc/loadavg: 6.84 6.88 6.94 9/457 6875
/proc/meminfo: memFree=14580472/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=236688 CPUtime=101.01 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 137599 1251 0 0 10078 23 0 0 18 0 9 0 703291835 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 59172 20414 180 55 0 57058 0
[pid=6861/tid=6868] ppid=6859 vsize=236688 CPUtime=12.61 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 18616 1251 0 0 1258 3 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=236688 CPUtime=12.64 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 23960 1251 0 0 1261 3 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4259882 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=236688 CPUtime=12.65 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 10791 1251 0 0 1263 2 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4358118 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=236688 CPUtime=12.64 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 9580 1251 0 0 1263 1 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=236688 CPUtime=12.64 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 18519 1251 0 0 1261 3 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=236688 CPUtime=12.63 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 20635 1251 0 0 1260 3 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=236688 CPUtime=12.64 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 10581 1251 0 0 1262 2 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=236688 CPUtime=12.46 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 21758 1251 0 0 1244 2 0 0 25 0 9 0 703291840 242368512 20414 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.01
Current children cumulated vsize (KiB) 236688

[startup+25.501 s]
/proc/loadavg: 7.09 6.94 6.95 9/457 6876
/proc/meminfo: memFree=14536012/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=281552 CPUtime=203.22 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 283483 1251 0 0 20273 49 0 0 18 0 9 0 703291835 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 70388 31630 180 55 0 68274 0
[pid=6861/tid=6868] ppid=6859 vsize=281552 CPUtime=25.4 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 38615 1251 0 0 2534 6 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=281552 CPUtime=25.44 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 45906 1251 0 0 2537 7 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=281552 CPUtime=25.44 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 31286 1251 0 0 2539 5 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=281552 CPUtime=25.44 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 15271 1251 0 0 2541 3 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=281552 CPUtime=25.44 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 38725 1251 0 0 2537 7 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=281552 CPUtime=25.43 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 41469 1251 0 0 2536 7 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=281552 CPUtime=25.43 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 29613 1251 0 0 2539 4 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4308643 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=281552 CPUtime=25.06 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 39439 1251 0 0 2501 5 0 0 25 0 9 0 703291840 288309248 31630 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.22
Current children cumulated vsize (KiB) 281552

[startup+51.1013 s]
/proc/loadavg: 7.40 7.02 6.98 9/457 6876
/proc/meminfo: memFree=14514844/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=302036 CPUtime=407.64 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 649422 1251 0 0 40660 104 0 0 18 0 9 0 703291835 309284864 36751 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 75509 36751 180 55 0 73395 0
[pid=6861/tid=6868] ppid=6859 vsize=302036 CPUtime=51 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 84406 1251 0 0 5086 14 0 0 25 0 9 0 703291840 309284864 36751 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=302036 CPUtime=51.04 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 109184 1251 0 0 5088 16 0 0 25 0 9 0 703291840 309284864 36751 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=302036 CPUtime=51.03 cores=0-7

################
# More data... #
################

/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647231 1251 0 0 466110 127 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1607820 CPUtime=4662.31 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2434592 1251 0 0 465905 326 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1607820 CPUtime=4662.37 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2683780 1251 0 0 465891 346 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1607820 CPUtime=4662.38 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2542084 1251 0 0 465907 331 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1607820 CPUtime=4592.47 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2550682 1251 0 0 458927 320 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37227
Current children cumulated vsize (KiB) 1607820

[startup+4722.32 s]
/proc/loadavg: 8.08 8.07 8.01 9/457 7022
/proc/meminfo: memFree=13201692/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1607820 CPUtime=37706.2 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 17662912 1251 0 0 3768255 2368 0 0 18 0 9 0 703291835 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 401955 363197 180 55 0 399841 0
[pid=6861/tid=6868] ppid=6859 vsize=1607820 CPUtime=4722.21 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2354369 1251 0 0 471916 305 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1607820 CPUtime=4722.38 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2235617 1251 0 0 471940 298 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4309871 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1607820 CPUtime=4720.44 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2186822 1251 0 0 471737 307 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1607820 CPUtime=4722.39 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647231 1251 0 0 472112 127 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1607820 CPUtime=4722.33 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2434592 1251 0 0 471907 326 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1607820 CPUtime=4722.39 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2683780 1251 0 0 471893 346 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1607820 CPUtime=4722.4 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2566660 1251 0 0 471905 335 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1607820 CPUtime=4651.57 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2550682 1251 0 0 464837 320 0 0 25 0 9 0 703291840 1646407680 363197 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37706.2
Current children cumulated vsize (KiB) 1607820

[startup+4782.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/457 7023
/proc/meminfo: memFree=13241192/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1569244 CPUtime=38185.2 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 17794342 1251 0 0 3816140 2384 0 0 18 0 9 0 703291835 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 392311 353553 180 55 0 390197 0
[pid=6861/tid=6868] ppid=6859 vsize=1569244 CPUtime=4782.2 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2364921 1251 0 0 477913 307 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1569244 CPUtime=4782.37 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2275483 1251 0 0 477934 303 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1569244 CPUtime=4780.41 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2235974 1251 0 0 477729 312 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1569244 CPUtime=4782.37 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647231 1251 0 0 478110 127 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1569244 CPUtime=4782.32 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2434592 1251 0 0 477906 326 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1569244 CPUtime=4782.38 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2687370 1251 0 0 477891 347 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1569244 CPUtime=4782.38 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2583044 1251 0 0 477902 336 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1569244 CPUtime=4710.69 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2562568 1251 0 0 470747 322 0 0 25 0 9 0 703291840 1606905856 353553 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38185.2
Current children cumulated vsize (KiB) 1569244

[startup+4842.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/457 7025
/proc/meminfo: memFree=13188928/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1621252 CPUtime=38664.3 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 17972724 1251 0 0 3864029 2405 0 0 18 0 9 0 703291835 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 405313 366555 180 55 0 403199 0
[pid=6861/tid=6868] ppid=6859 vsize=1621252 CPUtime=4842.2 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2364921 1251 0 0 483913 307 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1621252 CPUtime=4842.38 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2275483 1251 0 0 483935 303 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1621252 CPUtime=4840.4 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2317894 1251 0 0 483718 322 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1621252 CPUtime=4842.37 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647231 1251 0 0 484110 127 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1621252 CPUtime=4842.32 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2434592 1251 0 0 483906 326 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1621252 CPUtime=4842.39 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2734680 1251 0 0 483886 353 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1621252 CPUtime=4842.39 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2632196 1251 0 0 483896 343 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1621252 CPUtime=4769.8 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2562568 1251 0 0 476658 322 0 0 25 0 9 0 703291840 1660162048 366555 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38664.3
Current children cumulated vsize (KiB) 1621252

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/457 7027
/proc/meminfo: memFree=13156264/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1621292 CPUtime=39143.4 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 18046462 1251 0 0 3911931 2414 0 0 18 0 9 0 703291835 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 405323 366565 180 55 0 403209 0
[pid=6861/tid=6868] ppid=6859 vsize=1621292 CPUtime=4902.2 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2364921 1251 0 0 489913 307 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1621292 CPUtime=4902.38 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2283675 1251 0 0 489934 304 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1621292 CPUtime=4900.37 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2326086 1251 0 0 489715 322 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1621292 CPUtime=4902.37 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647241 1251 0 0 490110 127 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1621292 CPUtime=4902.32 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2434592 1251 0 0 489906 326 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1621292 CPUtime=4902.39 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2742872 1251 0 0 489885 354 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1621292 CPUtime=4902.39 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2681348 1251 0 0 489890 349 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1621292 CPUtime=4828.92 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2562568 1251 0 0 482570 322 0 0 25 0 9 0 703291840 1660203008 366565 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364699 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39143.4
Current children cumulated vsize (KiB) 1621292

[startup+4962.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/457 7028
/proc/meminfo: memFree=13239536/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1570088 CPUtime=39622.5 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 18140157 1251 0 0 3959828 2426 0 0 18 0 9 0 703291835 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 392522 353764 180 55 0 390408 0
[pid=6861/tid=6868] ppid=6859 vsize=1570088 CPUtime=4962.2 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2364921 1251 0 0 495913 307 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1570088 CPUtime=4962.38 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2300059 1251 0 0 495932 306 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1570088 CPUtime=4960.37 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2334278 1251 0 0 495713 324 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1570088 CPUtime=4962.38 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647241 1251 0 0 496111 127 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1570088 CPUtime=4962.32 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2438175 1251 0 0 495906 326 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1570088 CPUtime=4962.39 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2742872 1251 0 0 495885 354 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1570088 CPUtime=4962.39 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2746884 1251 0 0 495882 357 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1570088 CPUtime=4888 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2562568 1251 0 0 488478 322 0 0 25 0 9 0 703291840 1607770112 353764 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39622.5
Current children cumulated vsize (KiB) 1570088



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.6 s]
/proc/loadavg: 8.10 8.05 8.00 9/457 7030
/proc/meminfo: memFree=13207368/32951124 swapFree=63485464/67111528
[pid=6861] ppid=6859 vsize=1602856 CPUtime=40000.2 cores=0-7
/proc/6861/stat : 6861 (plingeling) S 6859 6861 6795 0 -1 4202496 18263037 1251 0 0 3997585 2440 0 0 18 0 9 0 703291835 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 220828039141 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/6861/statm: 400714 361956 180 55 0 398600 0
[pid=6861/tid=6868] ppid=6859 vsize=1602856 CPUtime=5009.52 cores=0-7
/proc/6861/task/6868/stat : 6868 (plingeling) R 6859 6861 6795 0 -1 4202560 2364921 1251 0 0 500645 307 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6861/tid=6869] ppid=6859 vsize=1602856 CPUtime=5009.69 cores=0-7
/proc/6861/task/6869/stat : 6869 (plingeling) R 6859 6861 6795 0 -1 4202560 2316443 1251 0 0 500662 307 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6861/tid=6870] ppid=6859 vsize=1602856 CPUtime=5007.67 cores=0-7
/proc/6861/task/6870/stat : 6870 (plingeling) R 6859 6861 6795 0 -1 4202560 2342470 1251 0 0 500442 325 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6861/tid=6871] ppid=6859 vsize=1602856 CPUtime=5009.69 cores=0-7
/proc/6861/task/6871/stat : 6871 (plingeling) R 6859 6861 6795 0 -1 4202560 647241 1251 0 0 500842 127 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6861/tid=6872] ppid=6859 vsize=1602856 CPUtime=5009.63 cores=0-7
/proc/6861/task/6872/stat : 6872 (plingeling) R 6859 6861 6795 0 -1 4202560 2438175 1251 0 0 500637 326 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6861/tid=6873] ppid=6859 vsize=1602856 CPUtime=5009.71 cores=0-7
/proc/6861/task/6873/stat : 6873 (plingeling) R 6859 6861 6795 0 -1 4202560 2759256 1251 0 0 500615 356 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6861/tid=6874] ppid=6859 vsize=1602856 CPUtime=5009.71 cores=0-7
/proc/6861/task/6874/stat : 6874 (plingeling) R 6859 6861 6795 0 -1 4202560 2828804 1251 0 0 500605 366 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6861/tid=6875] ppid=6859 vsize=1602856 CPUtime=4934.57 cores=0-7
/proc/6861/task/6875/stat : 6875 (plingeling) R 6859 6861 6795 0 -1 4202560 2562568 1251 0 0 493135 322 0 0 25 0 9 0 703291840 1641324544 361956 33554432000 4194304 4417452 140735443476576 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 1602856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.68
CPU time (s): 40000.4
CPU user time (s): 39976
CPU system time (s): 24.4623
CPU usage (%): 798.463
Max. virtual memory (cumulated for all children) (KiB): 2291460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39976
system time used= 24.4623
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18264288
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 390
involuntary context switches= 142280

runsolver used 20.8588 second user time and 54.2927 second system time

The end

Launcher Data 

Begin job on node147 at 2011-05-23 01:59:19
IDJOB=3394880
IDBENCH=85826
IDSOLVER=1851
FILE ID=node147/3394880-1306108759
RUNJOBID= node147-1306108759-6809
PBS_JOBID= 13388032
Free space on /tmp= 73400 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT05/crafted/sorge05/QG7/gensys-icl007.shuffled-as.sat05-3133.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394880-1306108759/watcher-3394880-1306108759 -o /tmp/evaluation-result-3394880-1306108759/solver-3394880-1306108759 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394880-1306108759.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 88361752c7b0c05e849791aafdd7bdba
RANDOM SEED=2013033624

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14659300 kB
Buffers:        358644 kB
Cached:        8314684 kB
SwapCached:      13096 kB
Active:        9880980 kB
Inactive:      8122272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14659300 kB
SwapTotal:    67111528 kB
SwapFree:     63485464 kB
Dirty:             412 kB
Writeback:           0 kB
AnonPages:     9325460 kB
Mapped:          26752 kB
Slab:           161408 kB
PageTables:      58056 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 120748304 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73400 MiB
End job on node147 at 2011-05-23 03:22:51