Trace number 3264718

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.41 1201.72

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2-rand3bip-sat/
mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
MD5SUM51d9aefd9da7f94abc32dd024090dc46
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.005998
Satisfiable
(Un)Satisfiability was proved
Number of variables270
Number of clauses1080
Sum of the clauses size3240
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31080
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264718-1304104995/watcher-3264718-1304104995 -o /tmp/evaluation-result-3264718-1304104995/solver-3264718-1304104995 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3264718-1304104995.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 419 1256 0 0 0 0 0 0 23 0 5 0 522099912 51367936 344 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 12541 344 167 55 0 10427 0
[pid=8581/tid=8587] ppid=8579 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 16 1256 0 0 0 0 0 0 24 0 5 0 522099913 51367936 344 33554432000 4194304 4417332 140736975091728 18446744073709551615 4325918 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 0 1256 0 0 0 0 0 0 24 0 5 0 522099913 51367936 344 33554432000 4194304 4417332 140736975091728 18446744073709551615 230809222129 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 0 1256 0 0 0 0 0 0 24 0 5 0 522099913 51367936 344 33554432000 4194304 4417332 140736975091728 18446744073709551615 230809222129 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 0 1256 0 0 0 0 0 0 24 0 5 0 522099913 51367936 344 33554432000 4194304 4417332 140736975091728 18446744073709551615 230809222129 0 0 4096 17442 0 0 0 -1 1 0 0 0

[startup+0.787628 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=121216 CPUtime=3.12 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 4512 1256 0 0 311 1 0 0 23 0 5 0 522099912 124125184 1725 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 30304 1725 179 55 0 28190 0
[pid=8581/tid=8587] ppid=8579 vsize=121216 CPUtime=0.77 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 1015 1256 0 0 77 0 0 0 18 0 5 0 522099913 124125184 1725 33554432000 4194304 4417332 140736975091728 18446744073709551615 4236630 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=121216 CPUtime=0.77 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 1100 1256 0 0 77 0 0 0 25 0 5 0 522099913 124125184 1725 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=121216 CPUtime=0.77 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 1078 1256 0 0 77 0 0 0 25 0 5 0 522099913 124125184 1725 33554432000 4194304 4417332 140736975091728 18446744073709551615 230809223594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=121216 CPUtime=0.77 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 916 1256 0 0 77 0 0 0 19 0 5 0 522099913 124125184 1725 33554432000 4194304 4417332 140736975091728 18446744073709551615 230808859629 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 121216

[startup+0.800351 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=121380 CPUtime=3.17 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 4580 1256 0 0 316 1 0 0 23 0 5 0 522099912 124293120 1793 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 30345 1793 179 55 0 28231 0
[pid=8581/tid=8587] ppid=8579 vsize=121380 CPUtime=0.79 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 1015 1256 0 0 79 0 0 0 18 0 5 0 522099913 124293120 1793 33554432000 4194304 4417332 140736975091728 18446744073709551615 4265335 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=121380 CPUtime=0.79 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 1141 1256 0 0 79 0 0 0 25 0 5 0 522099913 124293120 1793 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=121380 CPUtime=0.78 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 1105 1256 0 0 78 0 0 0 25 0 5 0 522099913 124293120 1793 33554432000 4194304 4417332 140736975091728 18446744073709551615 4352289 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=121380 CPUtime=0.79 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 916 1256 0 0 79 0 0 0 19 0 5 0 522099913 124293120 1793 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.17
Current children cumulated vsize (KiB) 121380

[startup+0.900333 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=120820 CPUtime=3.57 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 5050 1256 0 0 356 1 0 0 23 0 5 0 522099912 123719680 1655 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 30205 1655 179 55 0 28091 0
[pid=8581/tid=8587] ppid=8579 vsize=120820 CPUtime=0.89 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 1105 1256 0 0 89 0 0 0 19 0 5 0 522099913 123719680 1655 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=120820 CPUtime=0.89 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 1299 1256 0 0 89 0 0 0 25 0 5 0 522099913 123719680 1655 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=120820 CPUtime=0.88 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 1159 1256 0 0 88 0 0 0 25 0 5 0 522099913 123719680 1655 33554432000 4194304 4417332 140736975091728 18446744073709551615 4250750 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=120820 CPUtime=0.89 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 1084 1256 0 0 89 0 0 0 19 0 5 0 522099913 123719680 1655 33554432000 4194304 4417332 140736975091728 18446744073709551615 4358908 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.57
Current children cumulated vsize (KiB) 120820

[startup+1.00031 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=121612 CPUtime=3.97 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 5447 1256 0 0 396 1 0 0 23 0 5 0 522099912 124530688 1853 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 30403 1853 179 55 0 28289 0
[pid=8581/tid=8587] ppid=8579 vsize=121612 CPUtime=0.99 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 1173 1256 0 0 99 0 0 0 19 0 5 0 522099913 124530688 1853 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=121612 CPUtime=0.99 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 1339 1256 0 0 99 0 0 0 25 0 5 0 522099913 124530688 1853 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=121612 CPUtime=0.98 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 1286 1256 0 0 98 0 0 0 25 0 5 0 522099913 124530688 1853 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=121612 CPUtime=0.99 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 1246 1256 0 0 99 0 0 0 19 0 5 0 522099913 124530688 1853 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.97
Current children cumulated vsize (KiB) 121612

[startup+1.50022 s]
/proc/loadavg: 7.26 7.90 7.96 5/181 8581
/proc/meminfo: memFree=25919028/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=122260 CPUtime=5.97 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 7800 1256 0 0 596 1 0 0 23 0 5 0 522099912 125194240 2018 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 30565 2018 179 55 0 28451 0
[pid=8581/tid=8587] ppid=8579 vsize=122260 CPUtime=1.49 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 1757 1256 0 0 149 0 0 0 20 0 5 0 522099913 125194240 2018 33554432000 4194304 4417332 140736975091728 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=122260 CPUtime=1.49 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 1821 1256 0 0 149 0 0 0 25 0 5 0 522099913 125194240 2018 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=122260 CPUtime=1.48 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 1820 1256 0 0 148 0 0 0 25 0 5 0 522099913 125194240 2018 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=122260 CPUtime=1.48 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 1999 1256 0 0 148 0 0 0 20 0 5 0 522099913 125194240 2018 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 122260

[startup+3.10093 s]
/proc/loadavg: 7.26 7.90 7.96 9/186 8591
/proc/meminfo: memFree=25919128/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=126612 CPUtime=12.35 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 14767 1256 0 0 1233 2 0 0 23 0 5 0 522099912 129650688 3106 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 31653 3106 179 55 0 29539 0
[pid=8581/tid=8587] ppid=8579 vsize=126612 CPUtime=3.08 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 3315 1256 0 0 308 0 0 0 25 0 5 0 522099913 129650688 3106 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=126612 CPUtime=3.08 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 3316 1256 0 0 308 0 0 0 25 0 5 0 522099913 129650688 3106 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=126612 CPUtime=3.07 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 3653 1256 0 0 307 0 0 0 25 0 5 0 522099913 129650688 3106 33554432000 4194304 4417332 140736975091728 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=126612 CPUtime=3.08 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 4080 1256 0 0 308 0 0 0 25 0 5 0 522099913 129650688 3106 33554432000 4194304 4417332 140736975091728 18446744073709551615 4251045 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 126612

[startup+6.30034 s]
/proc/loadavg: 7.32 7.90 7.96 9/186 8591
/proc/meminfo: memFree=25911696/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=131752 CPUtime=25.15 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 26959 1256 0 0 2510 5 0 0 23 0 5 0 522099912 134914048 4359 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 32938 4359 179 55 0 30824 0
[pid=8581/tid=8587] ppid=8579 vsize=131752 CPUtime=6.29 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 5848 1256 0 0 628 1 0 0 25 0 5 0 522099913 134914048 4359 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=131752 CPUtime=6.29 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 5693 1256 0 0 628 1 0 0 25 0 5 0 522099913 134914048 4359 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=131752 CPUtime=6.26 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 6896 1256 0 0 625 1 0 0 25 0 5 0 522099913 134914048 4359 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=131752 CPUtime=6.29 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 8119 1256 0 0 628 1 0 0 25 0 5 0 522099913 134914048 4359 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 131752

[startup+12.7012 s]
/proc/loadavg: 7.37 7.90 7.96 9/186 8591
/proc/meminfo: memFree=25893292/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=136572 CPUtime=50.73 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 45812 1256 0 0 5066 7 0 0 23 0 5 0 522099912 139849728 5601 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 34143 5601 179 55 0 32029 0
[pid=8581/tid=8587] ppid=8579 vsize=136572 CPUtime=12.69 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 10331 1256 0 0 1268 1 0 0 25 0 5 0 522099913 139849728 5601 33554432000 4194304 4417332 140736975091728 18446744073709551615 4357034 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=136572 CPUtime=12.69 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 10341 1256 0 0 1268 1 0 0 25 0 5 0 522099913 139849728 5601 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=136572 CPUtime=12.63 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 11072 1256 0 0 1261 2 0 0 25 0 5 0 522099913 139849728 5601 33554432000 4194304 4417332 140736975091728 18446744073709551615 4250447 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=136572 CPUtime=12.69 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 13665 1256 0 0 1268 1 0 0 25 0 5 0 522099913 139849728 5601 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.73
Current children cumulated vsize (KiB) 136572

[startup+25.5008 s]
/proc/loadavg: 7.58 7.92 7.96 9/186 8592
/proc/meminfo: memFree=25898960/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=152340 CPUtime=101.85 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 81996 1256 0 0 10172 13 0 0 23 0 5 0 522099912 155996160 9543 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 38085 9543 179 55 0 35971 0
[pid=8581/tid=8587] ppid=8579 vsize=152340 CPUtime=25.49 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 18640 1256 0 0 2546 3 0 0 25 0 5 0 522099913 155996160 9543 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=152340 CPUtime=25.49 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 18916 1256 0 0 2546 3 0 0 25 0 5 0 522099913 155996160 9543 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=152340 CPUtime=25.35 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 19667 1256 0 0 2532 3 0 0 25 0 5 0 522099913 155996160 9543 33554432000 4194304 4417332 140736975091728 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=152340 CPUtime=25.49 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 24370 1256 0 0 2546 3 0 0 25 0 5 0 522099913 155996160 9543 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.85
Current children cumulated vsize (KiB) 152340

[startup+51.1011 s]
/proc/loadavg: 7.79 7.94 7.97 9/186 8592
/proc/meminfo: memFree=25873512/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=154640 CPUtime=204.11 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 130251 1256 0 0 20391 20 0 0 23 0 5 0 522099912 158351360 10118 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 38660 10118 179 55 0 36546 0
[pid=8581/tid=8587] ppid=8579 vsize=154640 CPUtime=51.09 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 28593 1256 0 0 5105 4 0 0 25 0 5 0 522099913 158351360 10118 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364965 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=154640 CPUtime=51.08 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 29534 1256 0 0 5104 4 0 0 25 0 5 0 522099913 158351360 10118 33554432000 4194304 4417332 140736975091728 18446744073709551615 4250759 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=154640 CPUtime=50.82 cores=1,3,5,7

################
# More data... #
################

[pid=8581/tid=8588] ppid=8579 vsize=226160 CPUtime=702.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 166247 1256 0 0 70205 26 0 0 25 0 5 0 522099913 231587840 27995 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=226160 CPUtime=698.48 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 207643 1256 0 0 69815 33 0 0 25 0 5 0 522099913 231587840 27995 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=226160 CPUtime=702.31 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 230631 1256 0 0 70198 33 0 0 25 0 5 0 522099913 231587840 27995 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.43
Current children cumulated vsize (KiB) 226160

[startup+762.301 s]
/proc/loadavg: 8.22 8.14 8.04 10/186 8648
/proc/meminfo: memFree=25520704/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=256616 CPUtime=3045.1 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 818515 1256 0 0 304387 123 0 0 23 0 5 0 522099912 262774784 35609 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 64154 35609 179 55 0 62040 0
[pid=8581/tid=8587] ppid=8579 vsize=256616 CPUtime=762.31 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 180786 1256 0 0 76206 25 0 0 25 0 5 0 522099913 262774784 35609 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=256616 CPUtime=762.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 177134 1256 0 0 76203 28 0 0 25 0 5 0 522099913 262774784 35609 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=256616 CPUtime=758.14 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 219010 1256 0 0 75780 34 0 0 25 0 5 0 522099913 262774784 35609 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=256616 CPUtime=762.31 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 241182 1256 0 0 76197 34 0 0 25 0 5 0 522099913 262774784 35609 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 256616

[startup+822.301 s]
/proc/loadavg: 8.21 8.14 8.05 10/186 8650
/proc/meminfo: memFree=25492876/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=257336 CPUtime=3284.8 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 850271 1256 0 0 328353 127 0 0 23 0 5 0 522099912 263512064 35767 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 64334 35767 179 55 0 62220 0
[pid=8581/tid=8587] ppid=8579 vsize=257336 CPUtime=822.32 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 190109 1256 0 0 82205 27 0 0 25 0 5 0 522099913 263512064 35767 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=257336 CPUtime=822.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 183376 1256 0 0 82203 28 0 0 25 0 5 0 522099913 263512064 35767 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=257336 CPUtime=817.82 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 225654 1256 0 0 81747 35 0 0 25 0 5 0 522099913 263512064 35767 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=257336 CPUtime=822.31 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 250729 1256 0 0 82196 35 0 0 25 0 5 0 522099913 263512064 35767 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.8
Current children cumulated vsize (KiB) 257336

[startup+882.301 s]
/proc/loadavg: 8.08 8.12 8.04 10/186 8651
/proc/meminfo: memFree=25501256/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=261132 CPUtime=3524.46 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 886954 1256 0 0 352315 131 0 0 23 0 5 0 522099912 267399168 36709 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 65283 36709 179 55 0 63169 0
[pid=8581/tid=8587] ppid=8579 vsize=261132 CPUtime=882.31 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 196468 1256 0 0 88204 27 0 0 25 0 5 0 522099913 267399168 36709 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=261132 CPUtime=882.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 190857 1256 0 0 88202 29 0 0 25 0 5 0 522099913 267399168 36709 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=261132 CPUtime=877.49 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 238593 1256 0 0 87713 36 0 0 25 0 5 0 522099913 267399168 36709 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=261132 CPUtime=882.31 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 260633 1256 0 0 88195 36 0 0 25 0 5 0 522099913 267399168 36709 33554432000 4194304 4417332 140736975091728 18446744073709551615 4365859 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.46
Current children cumulated vsize (KiB) 261132

[startup+942.307 s]
/proc/loadavg: 8.03 8.09 8.03 10/186 8653
/proc/meminfo: memFree=25477140/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=252276 CPUtime=3764.16 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 927254 1256 0 0 376279 137 0 0 23 0 5 0 522099912 258330624 34495 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 63069 34495 179 55 0 60955 0
[pid=8581/tid=8587] ppid=8579 vsize=252276 CPUtime=942.32 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 208943 1256 0 0 94202 30 0 0 25 0 5 0 522099913 258330624 34495 33554432000 4194304 4417332 140736975091728 18446744073709551615 4366319 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=252276 CPUtime=942.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 197536 1256 0 0 94201 30 0 0 25 0 5 0 522099913 258330624 34495 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=252276 CPUtime=937.17 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 248008 1256 0 0 93679 38 0 0 25 0 5 0 522099913 258330624 34495 33554432000 4194304 4417332 140736975091728 18446744073709551615 4365026 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=252276 CPUtime=942.32 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 272364 1256 0 0 94194 38 0 0 25 0 5 0 522099913 258330624 34495 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.16
Current children cumulated vsize (KiB) 252276

[startup+1002.3 s]
/proc/loadavg: 8.01 8.07 8.03 10/186 8655
/proc/meminfo: memFree=25477452/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=261064 CPUtime=4003.82 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 963206 1256 0 0 400239 143 0 0 23 0 5 0 522099912 267329536 36692 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 65266 36692 179 55 0 63152 0
[pid=8581/tid=8587] ppid=8579 vsize=261064 CPUtime=1002.31 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 217263 1256 0 0 100201 30 0 0 25 0 5 0 522099913 267329536 36692 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=261064 CPUtime=1002.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 208571 1256 0 0 100199 32 0 0 25 0 5 0 522099913 267329536 36692 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=261064 CPUtime=996.84 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 254009 1256 0 0 99645 39 0 0 25 0 5 0 522099913 267329536 36692 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=261064 CPUtime=1002.31 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 282960 1256 0 0 100192 39 0 0 25 0 5 0 522099913 267329536 36692 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.82
Current children cumulated vsize (KiB) 261064

[startup+1062.3 s]
/proc/loadavg: 8.00 8.06 8.02 10/186 8656
/proc/meminfo: memFree=25467348/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=262212 CPUtime=4243.5 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 989162 1256 0 0 424203 147 0 0 23 0 5 0 522099912 268505088 36997 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 65553 36997 179 55 0 63439 0
[pid=8581/tid=8587] ppid=8579 vsize=262212 CPUtime=1062.32 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 223660 1256 0 0 106200 32 0 0 25 0 5 0 522099913 268505088 36997 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=262212 CPUtime=1062.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 213847 1256 0 0 106198 33 0 0 25 0 5 0 522099913 268505088 36997 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=262212 CPUtime=1056.51 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 259546 1256 0 0 105612 39 0 0 25 0 5 0 522099913 268505088 36997 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=262212 CPUtime=1062.32 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 291706 1256 0 0 106191 41 0 0 25 0 5 0 522099913 268505088 36997 33554432000 4194304 4417332 140736975091728 18446744073709551615 4357191 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.5
Current children cumulated vsize (KiB) 262212

[startup+1122.3 s]
/proc/loadavg: 8.00 8.04 8.02 10/186 8658
/proc/meminfo: memFree=25406528/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=305120 CPUtime=4483.18 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 1024810 1256 0 0 448165 153 0 0 23 0 5 0 522099912 312442880 47706 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 76280 47706 179 55 0 74166 0
[pid=8581/tid=8587] ppid=8579 vsize=305120 CPUtime=1122.32 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 237033 1256 0 0 112198 34 0 0 25 0 5 0 522099913 312442880 47706 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=305120 CPUtime=1122.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 219823 1256 0 0 112197 34 0 0 25 0 5 0 522099913 312442880 47706 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=305120 CPUtime=1116.19 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 263592 1256 0 0 111579 40 0 0 25 0 5 0 522099913 312442880 47706 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=305120 CPUtime=1122.32 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 303959 1256 0 0 112189 43 0 0 25 0 5 0 522099913 312442880 47706 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.18
Current children cumulated vsize (KiB) 305120

[startup+1182.3 s]
/proc/loadavg: 8.00 8.03 8.01 10/186 8659
/proc/meminfo: memFree=25415528/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=262520 CPUtime=4722.85 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 1057069 1256 0 0 472127 158 0 0 23 0 5 0 522099912 268820480 37056 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 65630 37056 179 55 0 63516 0
[pid=8581/tid=8587] ppid=8579 vsize=262520 CPUtime=1182.33 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 243665 1256 0 0 118197 36 0 0 25 0 5 0 522099913 268820480 37056 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=262520 CPUtime=1182.31 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 228953 1256 0 0 118196 35 0 0 25 0 5 0 522099913 268820480 37056 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=262520 CPUtime=1175.85 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 271702 1256 0 0 117544 41 0 0 25 0 5 0 522099913 268820480 37056 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=262520 CPUtime=1182.32 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 312346 1256 0 0 118188 44 0 0 25 0 5 0 522099913 268820480 37056 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.85
Current children cumulated vsize (KiB) 262520



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.00 8.03 8.01 9/186 8660
/proc/meminfo: memFree=25326976/32951124 swapFree=67111524/67111528
[pid=8581] ppid=8579 vsize=309328 CPUtime=4800.36 cores=1,3,5,7
/proc/8581/stat : 8581 (plingeling) S 8579 8581 8397 0 -1 4202496 1068771 1256 0 0 479876 160 0 0 23 0 5 0 522099912 316751872 48758 33554432000 4194304 4417332 140736975091728 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/8581/statm: 77332 48758 179 55 0 75218 0
[pid=8581/tid=8587] ppid=8579 vsize=309328 CPUtime=1201.73 cores=1,3,5,7
/proc/8581/task/8587/stat : 8587 (plingeling) R 8579 8581 8397 0 -1 4202560 245684 1256 0 0 120137 36 0 0 25 0 5 0 522099913 316751872 48758 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8581/tid=8588] ppid=8579 vsize=309328 CPUtime=1201.73 cores=1,3,5,7
/proc/8581/task/8588/stat : 8588 (plingeling) R 8579 8581 8397 0 -1 4202560 233358 1256 0 0 120136 37 0 0 25 0 5 0 522099913 316751872 48758 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364887 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8581/tid=8589] ppid=8579 vsize=309328 CPUtime=1195.15 cores=1,3,5,7
/proc/8581/task/8589/stat : 8589 (plingeling) R 8579 8581 8397 0 -1 4202560 274079 1256 0 0 119474 41 0 0 25 0 5 0 522099913 316751872 48758 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8581/tid=8590] ppid=8579 vsize=309328 CPUtime=1201.73 cores=1,3,5,7
/proc/8581/task/8590/stat : 8590 (plingeling) R 8579 8581 8397 0 -1 4202560 315247 1256 0 0 120128 45 0 0 25 0 5 0 522099913 316751872 48758 33554432000 4194304 4417332 140736975091728 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 309328

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.41
CPU user time (s): 4798.79
CPU system time (s): 1.61875
CPU usage (%): 399.461
Max. virtual memory (cumulated for all children) (KiB): 309328

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.79
system time used= 1.61875
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1070028
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 147
involuntary context switches= 42477

runsolver used 1.87771 second user time and 4.66829 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 21:23:15
IDJOB=3264718
IDBENCH=85304
IDSOLVER=1605
FILE ID=node104/3264718-1304104995
RUNJOBID= node104-1304103906-8416
PBS_JOBID= 13170642
Free space on /tmp= 71548 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264718-1304104995/watcher-3264718-1304104995 -o /tmp/evaluation-result-3264718-1304104995/solver-3264718-1304104995 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3264718-1304104995.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 51d9aefd9da7f94abc32dd024090dc46
RANDOM SEED=1249337547

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25919316 kB
Buffers:       1889912 kB
Cached:        4392300 kB
SwapCached:          4 kB
Active:         315784 kB
Inactive:      6171624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25919316 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             736 kB
Writeback:           0 kB
AnonPages:      205136 kB
Mapped:          15288 kB
Slab:           480520 kB
PageTables:       5020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   389752 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71548 MiB
End job on node104 at 2011-04-29 21:43:18