Trace number 3370894

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.34 1202.88

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
MD5SUM08b4f1e095a7a4b98cb40c2c00e78d45
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.477926
Satisfiable
(Un)Satisfiability was proved
Number of variables952
Number of clauses84809
Sum of the clauses size170510
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284779
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370894-1305433230/watcher-3370894-1305433230 -o /tmp/evaluation-result-3370894-1305433230/solver-3370894-1305433230 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370894-1305433230.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.20 8.14 7.94 5/288 12744
/proc/meminfo: memFree=20695884/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=9480 CPUtime=0 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) R 12742 12744 4856 0 -1 4202496 429 1251 0 0 0 0 0 0 25 0 1 0 654921141 9707520 360 33554432000 4194304 4417452 140735082600256 18446744073709551615 232335892224 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/12744/statm: 2370 360 147 55 0 256 0

[startup+0.0342211 s]
/proc/loadavg: 8.20 8.14 7.94 5/288 12744
/proc/meminfo: memFree=20695884/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=13232 CPUtime=0.02 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) R 12742 12744 4856 0 -1 4202496 1490 1251 0 0 2 0 0 0 25 0 1 0 654921141 13549568 1331 33554432000 4194304 4417452 140735082600256 18446744073709551615 232335892224 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/12744/statm: 3308 1331 148 55 0 1194 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13232

[startup+0.163152 s]
/proc/loadavg: 8.20 8.14 7.94 5/288 12744
/proc/meminfo: memFree=20695884/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=60420 CPUtime=0.47 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 4717 1251 0 0 47 0 0 0 25 0 5 0 654921141 61870080 2921 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 15105 2921 177 55 0 12991 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 60420

[startup+0.30013 s]
/proc/loadavg: 8.20 8.14 7.94 5/288 12744
/proc/meminfo: memFree=20695884/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=63056 CPUtime=1.02 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 5945 1251 0 0 101 1 0 0 25 0 5 0 654921141 64569344 3551 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 15764 3551 180 55 0 13650 0
Current children cumulated CPU time (s) 1.02
Current children cumulated vsize (KiB) 63056

[startup+0.701058 s]
/proc/loadavg: 8.20 8.14 7.94 5/288 12744
/proc/meminfo: memFree=20695884/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=70488 CPUtime=2.62 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 8505 1251 0 0 261 1 0 0 25 0 5 0 654921141 72179712 5409 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 17622 5409 180 55 0 15508 0
Current children cumulated CPU time (s) 2.62
Current children cumulated vsize (KiB) 70488

[startup+1.50092 s]
/proc/loadavg: 8.20 8.14 7.94 9/293 12754
/proc/meminfo: memFree=20674028/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=79236 CPUtime=5.81 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 11601 1251 0 0 580 1 0 0 25 0 5 0 654921141 81137664 7596 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 19809 7596 180 55 0 17695 0
[pid=12744/tid=12751] ppid=12742 vsize=79236 CPUtime=1.44 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 1022 1251 0 0 144 0 0 0 25 0 5 0 654921147 81137664 7596 33554432000 4194304 4417452 140735082600256 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=79236 CPUtime=1.44 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 830 1251 0 0 144 0 0 0 25 0 5 0 654921147 81137664 7596 33554432000 4194304 4417452 140735082600256 18446744073709551615 4250080 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=79236 CPUtime=1.43 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 836 1251 0 0 143 0 0 0 25 0 5 0 654921147 81137664 7596 33554432000 4194304 4417452 140735082600256 18446744073709551615 4236689 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=79236 CPUtime=1.43 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 6387 1251 0 0 143 0 0 0 25 0 5 0 654921147 81137664 7596 33554432000 4194304 4417452 140735082600256 18446744073709551615 4236842 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.81
Current children cumulated vsize (KiB) 79236

[startup+3.10063 s]
/proc/loadavg: 8.20 8.14 7.94 9/293 12754
/proc/meminfo: memFree=20667744/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=81216 CPUtime=12.2 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 17760 1251 0 0 1218 2 0 0 25 0 5 0 654921141 83165184 8091 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 20304 8091 180 55 0 18190 0
[pid=12744/tid=12751] ppid=12742 vsize=81216 CPUtime=3.04 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 1022 1251 0 0 304 0 0 0 25 0 5 0 654921147 83165184 8091 33554432000 4194304 4417452 140735082600256 18446744073709551615 4249489 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=81216 CPUtime=3.04 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 830 1251 0 0 304 0 0 0 25 0 5 0 654921147 83165184 8091 33554432000 4194304 4417452 140735082600256 18446744073709551615 4258589 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=81216 CPUtime=3.02 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 1447 1251 0 0 302 0 0 0 25 0 5 0 654921147 83165184 8091 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=81216 CPUtime=3.03 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 11935 1251 0 0 302 1 0 0 25 0 5 0 654921147 83165184 8091 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.2
Current children cumulated vsize (KiB) 81216

[startup+6.30106 s]
/proc/loadavg: 8.19 8.13 7.94 9/293 12754
/proc/meminfo: memFree=20629924/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=93176 CPUtime=24.97 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 29563 1251 0 0 2493 4 0 0 25 0 5 0 654921141 95412224 11081 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 23294 11081 180 55 0 21180 0
[pid=12744/tid=12751] ppid=12742 vsize=93176 CPUtime=6.24 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 1022 1251 0 0 624 0 0 0 25 0 5 0 654921147 95412224 11081 33554432000 4194304 4417452 140735082600256 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=93176 CPUtime=6.24 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 830 1251 0 0 624 0 0 0 25 0 5 0 654921147 95412224 11081 33554432000 4194304 4417452 140735082600256 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=93176 CPUtime=6.19 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 3202 1251 0 0 619 0 0 0 25 0 5 0 654921147 95412224 11081 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=93176 CPUtime=6.24 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 21983 1251 0 0 621 3 0 0 25 0 5 0 654921147 95412224 11081 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.97
Current children cumulated vsize (KiB) 93176

[startup+12.7009 s]
/proc/loadavg: 8.17 8.13 7.94 10/293 12754
/proc/meminfo: memFree=20600020/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=217076 CPUtime=50.51 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 55230 1251 0 0 5044 7 0 0 25 0 5 0 654921141 222285824 25705 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 54269 25705 180 55 0 52155 0
[pid=12744/tid=12751] ppid=12742 vsize=217076 CPUtime=12.64 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 3945 1251 0 0 1264 0 0 0 25 0 5 0 654921147 222285824 25705 33554432000 4194304 4417452 140735082600256 18446744073709551615 4354448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=217076 CPUtime=12.63 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 2366 1251 0 0 1263 0 0 0 25 0 5 0 654921147 222285824 25705 33554432000 4194304 4417452 140735082600256 18446744073709551615 4309168 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=217076 CPUtime=12.53 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 5981 1251 0 0 1253 0 0 0 25 0 5 0 654921147 222285824 25705 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366094 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=217076 CPUtime=12.64 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 40412 1251 0 0 1259 5 0 0 25 0 5 0 654921147 222285824 25705 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 217076

[startup+25.5007 s]
/proc/loadavg: 8.13 8.12 7.94 9/293 12754
/proc/meminfo: memFree=20432004/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=277260 CPUtime=101.59 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 100532 1251 0 0 10145 14 0 0 25 0 5 0 654921141 283914240 40751 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 69315 40751 180 55 0 67201 0
[pid=12744/tid=12751] ppid=12742 vsize=277260 CPUtime=25.44 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 12949 1251 0 0 2543 1 0 0 25 0 5 0 654921147 283914240 40751 33554432000 4194304 4417452 140735082600256 18446744073709551615 4307697 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=277260 CPUtime=25.44 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 7837 1251 0 0 2543 1 0 0 25 0 5 0 654921147 283914240 40751 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=277260 CPUtime=25.2 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 18526 1251 0 0 2518 2 0 0 25 0 5 0 654921147 283914240 40751 33554432000 4194304 4417452 140735082600256 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=277260 CPUtime=25.44 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 58694 1251 0 0 2536 8 0 0 25 0 5 0 654921147 283914240 40751 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.59
Current children cumulated vsize (KiB) 277260

[startup+51.1011 s]
/proc/loadavg: 8.09 8.11 7.94 9/293 12755
/proc/meminfo: memFree=20484932/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=371524 CPUtime=203.76 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 146095 1251 0 0 20357 19 0 0 25 0 5 0 654921141 380440576 64317 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 92881 64317 180 55 0 90767 0
[pid=12744/tid=12751] ppid=12742 vsize=371524 CPUtime=51.03 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 25961 1251 0 0 5101 2 0 0 25 0 5 0 654921147 380440576 64317 33554432000 4194304 4417452 140735082600256 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=371524 CPUtime=51.04 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 18471 1251 0 0 5102 2 0 0 25 0 5 0 654921147 380440576 64317 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=371524 CPUtime=50.58 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 35322 1251 0 0 5054 4 0 0 25 0 5 0 654921147 380440576 64317 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=371524 CPUtime=51.04 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 63815 1251 0 0 5095 9 0 0 25 0 5 0 654921147 380440576 64317 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.76
Current children cumulated vsize (KiB) 371524

[startup+102.311 s]
/proc/loadavg: 8.04 8.09 7.94 9/293 12757
/proc/meminfo: memFree=20275724/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=473272 CPUtime=408.14 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 275250 1251 0 0 40776 38 0 0 25 0 5 0 654921141 484630528 89754 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 118318 89754 180 55 0 116204 0
[pid=12744/tid=12751] ppid=12742 vsize=473272 CPUtime=102.25 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 53252 1251 0 0 10218 7 0 0 25 0 5 0 654921147 484630528 89754 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=473272 CPUtime=102.24 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 40707 1251 0 0 10219 5 0 0 25 0 5 0 654921147 484630528 89754 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=473272 CPUtime=101.32 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 67323 1251 0 0 10123 9 0 0 25 0 5 0 654921147 484630528 89754 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=473272 CPUtime=102.25 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 111442 1251 0 0 10209 16 0 0 25 0 5 0 654921147 484630528 89754 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.14
Current children cumulated vsize (KiB) 473272

[startup+162.3 s]
/proc/loadavg: 8.07 8.09 7.95 9/293 12758
/proc/meminfo: memFree=19892540/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=571944 CPUtime=647.56 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 376286 1251 0 0 64704 52 0 0 25 0 5 0 654921141 585670656 114422 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 142986 114422 180 55 0 140872 0
[pid=12744/tid=12751] ppid=12742 vsize=571944 CPUtime=162.24 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 76230 1251 0 0 16215 9 0 0 25 0 5 0 654921147 585670656 114422 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=571944 CPUtime=162.23 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 60402 1251 0 0 16215 8 0 0 25 0 5 0 654921147 585670656 114422 33554432000 4194304 4417452 140735082600256 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=571944 CPUtime=160.76 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 96452 1251 0 0 16064 12 0 0 25 0 5 0 654921147 585670656 114422 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=571944 CPUtime=162.23 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 140676 1251 0 0 16203 20 0 0 25 0 5 0 654921147 585670656 114422 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.56
Current children cumulated vsize (KiB) 571944


################
# More data... #
################

[pid=12744/tid=12752] ppid=12742 vsize=1241212 CPUtime=702.25 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 222769 1251 0 0 70195 30 0 0 25 0 5 0 654921147 1271001088 281739 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1241212 CPUtime=695.87 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 213831 1251 0 0 69556 31 0 0 25 0 5 0 654921147 1271001088 281739 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1241212 CPUtime=702.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 307833 1251 0 0 70178 48 0 0 25 0 5 0 654921147 1271001088 281739 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2802.71
Current children cumulated vsize (KiB) 1241212

[startup+762.311 s]
/proc/loadavg: 8.15 8.17 8.05 9/293 12774
/proc/meminfo: memFree=18420000/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1421832 CPUtime=3042.21 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1019809 1251 0 0 304075 146 0 0 25 0 5 0 654921141 1455955968 326894 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 355458 326894 180 55 0 353344 0
[pid=12744/tid=12751] ppid=12742 vsize=1421832 CPUtime=762.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 227696 1251 0 0 76198 28 0 0 25 0 5 0 654921147 1455955968 326894 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1421832 CPUtime=762.26 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 239154 1251 0 0 76194 32 0 0 25 0 5 0 654921147 1455955968 326894 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1421832 CPUtime=755.33 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 222023 1251 0 0 75501 32 0 0 25 0 5 0 654921147 1455955968 326894 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1421832 CPUtime=762.27 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 328410 1251 0 0 76176 51 0 0 25 0 5 0 654921147 1455955968 326894 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3042.21
Current children cumulated vsize (KiB) 1421832

[startup+822.301 s]
/proc/loadavg: 8.13 8.17 8.05 9/293 12776
/proc/meminfo: memFree=18270428/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1441284 CPUtime=3281.64 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1041057 1251 0 0 328015 149 0 0 25 0 5 0 654921141 1475874816 331757 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 360321 331757 180 55 0 358207 0
[pid=12744/tid=12751] ppid=12742 vsize=1441284 CPUtime=822.25 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 232560 1251 0 0 82196 29 0 0 25 0 5 0 654921147 1475874816 331757 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1441284 CPUtime=822.25 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 239154 1251 0 0 82193 32 0 0 25 0 5 0 654921147 1475874816 331757 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1441284 CPUtime=814.78 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 230215 1251 0 0 81445 33 0 0 25 0 5 0 654921147 1475874816 331757 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1441284 CPUtime=822.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 336602 1251 0 0 82174 52 0 0 25 0 5 0 654921147 1475874816 331757 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3281.64
Current children cumulated vsize (KiB) 1441284

[startup+882.3 s]
/proc/loadavg: 8.22 8.19 8.07 9/293 12777
/proc/meminfo: memFree=17986680/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1650516 CPUtime=3521.09 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1101557 1251 0 0 351948 161 0 0 25 0 5 0 654921141 1690128384 384065 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 412629 384065 180 55 0 410515 0
[pid=12744/tid=12751] ppid=12742 vsize=1650516 CPUtime=882.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 240752 1251 0 0 88196 30 0 0 25 0 5 0 654921147 1690128384 384065 33554432000 4194304 4417452 140735082600256 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1650516 CPUtime=882.25 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 259870 1251 0 0 88189 36 0 0 25 0 5 0 654921147 1690128384 384065 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1650516 CPUtime=874.23 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 232396 1251 0 0 87390 33 0 0 25 0 5 0 654921147 1690128384 384065 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1650516 CPUtime=882.25 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 366013 1251 0 0 88167 58 0 0 25 0 5 0 654921147 1690128384 384065 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3521.09
Current children cumulated vsize (KiB) 1650516

[startup+942.301 s]
/proc/loadavg: 8.24 8.21 8.08 9/293 12779
/proc/meminfo: memFree=17994468/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1597492 CPUtime=3760.55 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1129261 1251 0 0 375889 166 0 0 25 0 5 0 654921141 1635831808 370809 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 399373 370809 180 55 0 397259 0
[pid=12744/tid=12751] ppid=12742 vsize=1597492 CPUtime=942.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 248944 1251 0 0 94195 31 0 0 25 0 5 0 654921147 1635831808 370809 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1597492 CPUtime=942.26 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 259870 1251 0 0 94189 37 0 0 25 0 5 0 654921147 1635831808 370809 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1597492 CPUtime=933.7 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 251908 1251 0 0 93332 38 0 0 25 0 5 0 654921147 1635831808 370809 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1597492 CPUtime=942.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 366013 1251 0 0 94168 58 0 0 25 0 5 0 654921147 1635831808 370809 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3760.55
Current children cumulated vsize (KiB) 1597492

[startup+1002.3 s]
/proc/loadavg: 6.13 7.67 7.91 5/283 12799
/proc/meminfo: memFree=19923972/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1695796 CPUtime=4000.01 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1162029 1251 0 0 399831 170 0 0 25 0 5 0 654921141 1736495104 395385 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 423949 395385 180 55 0 421835 0
[pid=12744/tid=12751] ppid=12742 vsize=1695796 CPUtime=1002.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 257136 1251 0 0 100194 32 0 0 25 0 5 0 654921147 1736495104 395385 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1695796 CPUtime=1002.25 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 276254 1251 0 0 100187 38 0 0 25 0 5 0 654921147 1736495104 395385 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1695796 CPUtime=993.15 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 251908 1251 0 0 99277 38 0 0 25 0 5 0 654921147 1736495104 395385 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1695796 CPUtime=1002.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 374205 1251 0 0 100166 60 0 0 25 0 5 0 654921147 1736495104 395385 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4000.01
Current children cumulated vsize (KiB) 1695796

[startup+1062.3 s]
/proc/loadavg: 4.91 7.03 7.67 5/283 12800
/proc/meminfo: memFree=19816808/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1802688 CPUtime=4239.48 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1213328 1251 0 0 423771 177 0 0 25 0 5 0 654921141 1845952512 422108 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 450672 422108 180 55 0 448558 0
[pid=12744/tid=12751] ppid=12742 vsize=1802688 CPUtime=1062.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 267474 1251 0 0 106193 33 0 0 25 0 5 0 654921147 1845952512 422108 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1802688 CPUtime=1062.25 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 284447 1251 0 0 106186 39 0 0 25 0 5 0 654921147 1845952512 422108 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1802688 CPUtime=1052.61 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 268292 1251 0 0 105221 40 0 0 25 0 5 0 654921147 1845952512 422108 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1802688 CPUtime=1062.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 390589 1251 0 0 106164 62 0 0 25 0 5 0 654921147 1845952512 422108 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4239.48
Current children cumulated vsize (KiB) 1802688

[startup+1122.3 s]
/proc/loadavg: 4.37 6.49 7.44 5/283 12802
/proc/meminfo: memFree=20087112/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1532308 CPUtime=4478.94 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1250955 1251 0 0 447709 185 0 0 25 0 5 0 654921141 1569083392 354513 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 383077 354513 180 55 0 380963 0
[pid=12744/tid=12751] ppid=12742 vsize=1532308 CPUtime=1122.26 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 267474 1251 0 0 112193 33 0 0 25 0 5 0 654921147 1569083392 354513 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1532308 CPUtime=1122.26 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 284447 1251 0 0 112186 40 0 0 25 0 5 0 654921147 1569083392 354513 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1532308 CPUtime=1112.06 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 268292 1251 0 0 111166 40 0 0 25 0 5 0 654921147 1569083392 354513 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1532308 CPUtime=1122.26 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 428216 1251 0 0 112156 70 0 0 25 0 5 0 654921147 1569083392 354513 33554432000 4194304 4417452 140735082600256 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4478.94
Current children cumulated vsize (KiB) 1532308

[startup+1182.3 s]
/proc/loadavg: 4.13 6.04 7.22 5/283 12803
/proc/meminfo: memFree=19923776/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1696044 CPUtime=4718.4 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1291889 1251 0 0 471649 191 0 0 25 0 5 0 654921141 1736749056 395447 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 424011 395447 180 55 0 421897 0
[pid=12744/tid=12751] ppid=12742 vsize=1696044 CPUtime=1182.27 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 267474 1251 0 0 118194 33 0 0 25 0 5 0 654921147 1736749056 395447 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1696044 CPUtime=1182.26 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 292640 1251 0 0 118186 40 0 0 25 0 5 0 654921147 1736749056 395447 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1696044 CPUtime=1171.52 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 294405 1251 0 0 117108 44 0 0 25 0 5 0 654921147 1736749056 395447 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1696044 CPUtime=1182.27 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 434844 1251 0 0 118156 71 0 0 25 0 5 0 654921147 1736749056 395447 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4718.4
Current children cumulated vsize (KiB) 1696044



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 4.10 5.90 7.15 5/283 12804
/proc/meminfo: memFree=19858052/32951124 swapFree=66457188/67111528
[pid=12744] ppid=12742 vsize=1761580 CPUtime=4800.23 cores=1,3,5,7
/proc/12744/stat : 12744 (plingeling) S 12742 12744 4856 0 -1 4202496 1308273 1251 0 0 479829 194 0 0 25 0 5 0 654921141 1803857920 411831 33554432000 4194304 4417452 140735082600256 18446744073709551615 232347695077 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/12744/statm: 440395 411831 180 55 0 438281 0
[pid=12744/tid=12751] ppid=12742 vsize=1761580 CPUtime=1202.78 cores=1,3,5,7
/proc/12744/task/12751/stat : 12751 (plingeling) R 12742 12744 4856 0 -1 4202560 267474 1251 0 0 120245 33 0 0 25 0 5 0 654921147 1803857920 411831 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12744/tid=12752] ppid=12742 vsize=1761580 CPUtime=1202.77 cores=1,3,5,7
/proc/12744/task/12752/stat : 12752 (plingeling) R 12742 12744 4856 0 -1 4202560 309024 1251 0 0 120234 43 0 0 25 0 5 0 654921147 1803857920 411831 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12744/tid=12753] ppid=12742 vsize=1761580 CPUtime=1191.83 cores=1,3,5,7
/proc/12744/task/12753/stat : 12753 (plingeling) R 12742 12744 4856 0 -1 4202560 294405 1251 0 0 119139 44 0 0 25 0 5 0 654921147 1803857920 411831 33554432000 4194304 4417452 140735082600256 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12744/tid=12754] ppid=12742 vsize=1761580 CPUtime=1202.78 cores=1,3,5,7
/proc/12744/task/12754/stat : 12754 (plingeling) R 12742 12744 4856 0 -1 4202560 434844 1251 0 0 120207 71 0 0 25 0 5 0 654921147 1803857920 411831 33554432000 4194304 4417452 140735082600256 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 1761580

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.88
CPU time (s): 4800.34
CPU user time (s): 4798.33
CPU system time (s): 2.00669
CPU usage (%): 399.071
Max. virtual memory (cumulated for all children) (KiB): 1802688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.33
system time used= 2.00669
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1309525
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 23337

runsolver used 3.00354 second user time and 7.94679 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-15 06:20:30
IDJOB=3370894
IDBENCH=88227
IDSOLVER=1848
FILE ID=node132/3370894-1305433230
RUNJOBID= node132-1305432982-12565
PBS_JOBID= 13324569
Free space on /tmp= 73364 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370894-1305433230/watcher-3370894-1305433230 -o /tmp/evaluation-result-3370894-1305433230/solver-3370894-1305433230 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370894-1305433230.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 08b4f1e095a7a4b98cb40c2c00e78d45
RANDOM SEED=902550553

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20696164 kB
Buffers:        288884 kB
Cached:        5610440 kB
SwapCached:       6904 kB
Active:        5618788 kB
Inactive:      6330784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20696164 kB
SwapTotal:    67111528 kB
SwapFree:     66457188 kB
Dirty:             844 kB
Writeback:           0 kB
AnonPages:     6048056 kB
Mapped:          19480 kB
Slab:           217376 kB
PageTables:      25780 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 35606380 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73368 MiB
End job on node132 at 2011-05-15 06:40:35