Trace number 3371428

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.48 1226.17

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf
MD5SUM9a43349587a435e7109b46b3aceb156e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1263.53
Satisfiable
(Un)Satisfiability was proved
Number of variables482093
Number of clauses9676386
Sum of the clauses size28195028
Maximum clause length226
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29152157
Number of clauses of size 3120945
Number of clauses of size 410067
Number of clauses of size 528986
Number of clauses of size over 5364230

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371428-1305431150/watcher-3371428-1305431150 -o /tmp/evaluation-result-3371428-1305431150/solver-3371428-1305431150 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371428-1305431150.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.53 4.95 6.34 7/286 13901
/proc/meminfo: memFree=18143724/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 214 0 0 0 0 0 0 0 24 0 1 0 654716337 8937472 145 33554432000 4194304 4417452 140733447803664 18446744073709551615 274664808192 0 0 4096 0 18446744071562362840 0 0 17 3 0 0 0
/proc/13901/statm: 2182 145 122 55 0 68 0

[startup+0.0299761 s]
/proc/loadavg: 4.53 4.95 6.34 7/286 13901
/proc/meminfo: memFree=18143724/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 214 0 0 0 0 0 0 0 24 0 1 0 654716337 8937472 145 33554432000 4194304 4417452 140733447803664 18446744073709551615 274664808192 0 0 4096 0 18446744071562362840 0 0 17 3 0 0 0
/proc/13901/statm: 2182 145 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.100971 s]
/proc/loadavg: 4.53 4.95 6.34 7/286 13901
/proc/meminfo: memFree=18143724/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 214 0 0 0 0 0 0 0 24 0 1 0 654716337 8937472 145 33554432000 4194304 4417452 140733447803664 18446744073709551615 274664808192 0 0 4096 0 18446744071562362840 0 0 17 3 0 0 0
/proc/13901/statm: 2182 145 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.30088 s]
/proc/loadavg: 4.53 4.95 6.34 7/286 13901
/proc/meminfo: memFree=18143724/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=14984 CPUtime=0.12 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) R 13899 13901 6618 0 -1 4202496 1838 1251 0 0 0 0 1 11 22 0 1 0 654716337 15343616 1768 33554432000 4194304 4417452 140733447803664 18446744073709551615 4264862 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/13901/statm: 3746 1768 148 55 0 1632 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 14984

[startup+0.700849 s]
/proc/loadavg: 4.53 4.95 6.34 7/286 13901
/proc/meminfo: memFree=18143724/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=65176 CPUtime=0.52 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) R 13899 13901 6618 0 -1 4202496 14390 1251 0 0 38 2 1 11 22 0 1 0 654716337 66740224 14317 33554432000 4194304 4417452 140733447803664 18446744073709551615 274664808192 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/13901/statm: 16294 14317 149 55 0 14180 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 65176

[startup+1.50071 s]
/proc/loadavg: 4.89 5.02 6.35 6/287 13907
/proc/meminfo: memFree=18027628/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=150828 CPUtime=1.31 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) R 13899 13901 6618 0 -1 4202496 35803 1251 0 0 114 5 1 11 25 0 1 0 654716337 154447872 35730 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236008 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/13901/statm: 37707 35730 149 55 0 35593 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 150828

[startup+3.10043 s]
/proc/loadavg: 4.89 5.02 6.35 6/287 13907
/proc/meminfo: memFree=17901696/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=417280 CPUtime=2.91 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) R 13899 13901 6618 0 -1 4202496 102428 1251 0 0 265 14 1 11 25 0 1 0 654716337 427294720 102343 33554432000 4194304 4417452 140733447803664 18446744073709551615 4231291 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/13901/statm: 104320 102343 149 55 0 102206 0
Current children cumulated CPU time (s) 2.91
Current children cumulated vsize (KiB) 417280

[startup+6.30088 s]
/proc/loadavg: 4.89 5.02 6.35 6/287 13907
/proc/meminfo: memFree=17545752/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=819564 CPUtime=6.12 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) R 13899 13901 6618 0 -1 4202496 203102 1251 0 0 572 28 1 11 25 0 1 0 654716337 839233536 202914 33554432000 4194304 4417452 140733447803664 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/13901/statm: 204891 202914 149 55 0 202777 0
Current children cumulated CPU time (s) 6.12
Current children cumulated vsize (KiB) 819564

[startup+12.7007 s]
/proc/loadavg: 5.60 5.16 6.38 10/291 13911
/proc/meminfo: memFree=17153464/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=999896 CPUtime=17.3 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 276507 1251 0 0 1596 122 1 11 25 0 5 0 654716337 1023893504 234207 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 249974 234207 168 55 0 247860 0
[pid=13901/tid=13908] ppid=13899 vsize=999896 CPUtime=2.31 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 13446 1251 0 0 213 6 1 11 25 0 5 0 654717387 1023893504 234207 33554432000 4194304 4417452 140733447803664 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=999896 CPUtime=2.2 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 13335 1251 0 0 202 6 1 11 21 0 5 0 654717387 1023893504 234207 33554432000 4194304 4417452 140733447803664 18446744073709551615 4287388 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=999896 CPUtime=2.18 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 13843 1251 0 0 197 9 1 11 19 0 5 0 654717387 1023893504 234207 33554432000 4194304 4417452 140733447803664 18446744073709551615 4240037 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=999896 CPUtime=0.74 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 1 1251 0 0 1 61 1 11 25 0 5 0 654717387 1023893504 234207 33554432000 4194304 4417452 140733447803664 18446744073709551615 274664866218 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 17.3
Current children cumulated vsize (KiB) 999896

[startup+25.5005 s]
/proc/loadavg: 6.51 5.37 6.44 11/291 13912
/proc/meminfo: memFree=17037924/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1035708 CPUtime=56.41 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 477205 1251 0 0 5405 224 1 11 25 0 5 0 654716337 1060564992 239128 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 258927 239128 177 55 0 256813 0
[pid=13901/tid=13908] ppid=13899 vsize=1035708 CPUtime=14.87 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 82734 1251 0 0 1460 15 1 11 25 0 5 0 654717387 1060564992 239128 33554432000 4194304 4417452 140733447803664 18446744073709551615 4234397 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1035708 CPUtime=12.71 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 46105 1251 0 0 1248 11 1 11 25 0 5 0 654717387 1060564992 239128 33554432000 4194304 4417452 140733447803664 18446744073709551615 4265792 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1035708 CPUtime=12.03 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 107609 1251 0 0 1159 32 1 11 25 0 5 0 654717387 1060564992 239128 33554432000 4194304 4417452 140733447803664 18446744073709551615 4233238 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1035708 CPUtime=6.94 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 4875 1251 0 0 557 125 1 11 25 0 5 0 654717387 1060564992 239128 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 56.41
Current children cumulated vsize (KiB) 1035708

[startup+51.1011 s]
/proc/loadavg: 8.95 6.03 6.63 12/291 13912
/proc/meminfo: memFree=16666264/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1468928 CPUtime=132.88 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 641619 1251 0 0 13022 254 1 11 25 0 5 0 654716337 1504182272 352070 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 367232 352070 179 55 0 365118 0
[pid=13901/tid=13908] ppid=13899 vsize=1468928 CPUtime=40.36 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 125206 1251 0 0 4002 22 1 11 25 0 5 0 654717387 1504182272 352070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232615 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1468928 CPUtime=25.51 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 111642 1251 0 0 2518 21 1 11 25 0 5 0 654717387 1504182272 352070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4239411 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1468928 CPUtime=37.4 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 164014 1251 0 0 3684 44 1 11 25 0 5 0 654717387 1504182272 352070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364474 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1468928 CPUtime=19.74 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 4875 1251 0 0 1837 125 1 11 25 0 5 0 654717387 1504182272 352070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232755 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 132.88
Current children cumulated vsize (KiB) 1468928

[startup+102.311 s]
/proc/loadavg: 9.32 6.69 6.82 9/291 13914
/proc/meminfo: memFree=16678628/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1549220 CPUtime=315.46 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 661713 1251 0 0 31273 261 1 11 25 0 5 0 654716337 1586401280 360404 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 387305 360404 179 55 0 385191 0
[pid=13901/tid=13908] ppid=13899 vsize=1549220 CPUtime=91.45 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 131976 1251 0 0 9106 27 1 11 25 0 5 0 654717387 1586401280 360404 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1549220 CPUtime=65.86 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 121346 1251 0 0 6550 24 1 11 25 0 5 0 654717387 1586401280 360404 33554432000 4194304 4417452 140733447803664 18446744073709551615 4302940 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1549220 CPUtime=88.14 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 167634 1251 0 0 8758 44 1 11 25 0 5 0 654717387 1586401280 360404 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1549220 CPUtime=60.15 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 4875 1251 0 0 5878 125 1 11 25 0 5 0 654717387 1586401280 360404 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 315.46
Current children cumulated vsize (KiB) 1549220

[startup+162.301 s]
/proc/loadavg: 8.48 6.93 6.89 9/291 13915
/proc/meminfo: memFree=16903496/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1294732 CPUtime=554.84 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 895258 1251 0 0 55179 293 1 11 25 0 5 0 654716337 1325805568 296814 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 323683 296814 179 55 0 321569 0
[pid=13901/tid=13908] ppid=13899 vsize=1294732 CPUtime=151.41 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 211857 1251 0 0 15091 38 1 11 25 0 5 0 654717387 1325805568 296814 33554432000 4194304 4417452 140733447803664 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1294732 CPUtime=125.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 197634 1251 0 0 12538 33 1 11 25 0 5 0 654717387 1325805568 296814 33554432000 4194304 4417452 140733447803664 18446744073709551615 4240307 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1294732 CPUtime=147.59 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 245010 1251 0 0 14692 55 1 11 25 0 5 0 654717387 1325805568 296814 33554432000 4194304 4417452 140733447803664 18446744073709551615 4365323 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1294732 CPUtime=120.14 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 4875 1251 0 0 11877 125 1 11 25 0 5 0 654717387 1325805568 296814 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 554.84
Current children cumulated vsize (KiB) 1294732

[startup+222.3 s]
/proc/loadavg: 8.22 7.14 6.96 9/291 13917
/proc/meminfo: memFree=16960408/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1217336 CPUtime=794.28 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1033329 1251 0 0 79101 315 1 11 25 0 5 0 654716337 1246552064 277433 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 304334 277433 179 55 0 302220 0
[pid=13901/tid=13908] ppid=13899 vsize=1217336 CPUtime=211.41 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 245903 1251 0 0 21086 43 1 11 25 0 5 0 654717387 1246552064 277433 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1217336 CPUtime=185.82 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 234709 1251 0 0 18531 39 1 11 25 0 5 0 654717387 1246552064 277433 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1217336 CPUtime=207.05 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 279192 1251 0 0 20633 60 1 11 25 0 5 0 654717387 1246552064 277433 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1217336 CPUtime=180.15 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 37643 1251 0 0 17870 133 1 11 25 0 5 0 654717387 1246552064 277433 33554432000 4194304 4417452 140733447803664 18446744073709551615 4237157 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 794.28
Current children cumulated vsize (KiB) 1217336

[startup+282.301 s]
/proc/loadavg: 8.19 7.32 7.04 9/291 13918
/proc/meminfo: memFree=16914884/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1255440 CPUtime=1033.75 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1047275 1251 0 0 103046 317 1 11 25 0 5 0 654716337 1285570560 286959 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 313860 286959 179 55 0 311746 0
[pid=13901/tid=13908] ppid=13899 vsize=1255440 CPUtime=271.41 cores=1,3,5,7

################
# More data... #
################

[pid=13901/tid=13909] ppid=13899 vsize=1553864 CPUtime=725.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 407255 1251 0 0 72508 63 1 11 25 0 5 0 654717387 1591156736 367607 33554432000 4194304 4417452 140733447803664 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1553864 CPUtime=742.15 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 406399 1251 0 0 74124 79 1 11 25 0 5 0 654717387 1591156736 367607 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1553864 CPUtime=720.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 115660 1251 0 0 71862 143 1 11 25 0 5 0 654717387 1591156736 367607 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2949.41
Current children cumulated vsize (KiB) 1553864

[startup+822.301 s]
/proc/loadavg: 8.15 7.99 7.50 9/291 13933
/proc/meminfo: memFree=15602256/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1690812 CPUtime=3188.83 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1665898 1251 0 0 318464 407 1 11 25 0 5 0 654716337 1731391488 395809 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 422703 395809 180 55 0 420589 0
[pid=13901/tid=13908] ppid=13899 vsize=1690812 CPUtime=811.37 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 428379 1251 0 0 81054 71 1 11 25 0 5 0 654717387 1731391488 395809 33554432000 4194304 4417452 140733447803664 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1690812 CPUtime=785.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 412911 1251 0 0 78507 64 1 11 25 0 5 0 654717387 1731391488 395809 33554432000 4194304 4417452 140733447803664 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1690812 CPUtime=801.6 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 439360 1251 0 0 80065 83 1 11 25 0 5 0 654717387 1731391488 395809 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232770 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1690812 CPUtime=780.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 149366 1251 0 0 77857 148 1 11 25 0 5 0 654717387 1731391488 395809 33554432000 4194304 4417452 140733447803664 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3188.83
Current children cumulated vsize (KiB) 1690812

[startup+882.301 s]
/proc/loadavg: 6.37 7.57 7.39 5/281 13951
/proc/meminfo: memFree=17238808/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1555848 CPUtime=3428.28 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1696461 1251 0 0 342402 414 1 11 25 0 5 0 654716337 1593188352 362068 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 388962 362068 180 55 0 386848 0
[pid=13901/tid=13908] ppid=13899 vsize=1555848 CPUtime=871.37 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 428379 1251 0 0 87054 71 1 11 25 0 5 0 654717387 1593188352 362068 33554432000 4194304 4417452 140733447803664 18446744073709551615 4366523 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1555848 CPUtime=845.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 412911 1251 0 0 84507 64 1 11 25 0 5 0 654717387 1593188352 362068 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1555848 CPUtime=861.06 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 445297 1251 0 0 86009 85 1 11 25 0 5 0 654717387 1593188352 362068 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1555848 CPUtime=840.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 173992 1251 0 0 83851 154 1 11 25 0 5 0 654717387 1593188352 362068 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236797 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3428.28
Current children cumulated vsize (KiB) 1555848

[startup+942.301 s]
/proc/loadavg: 4.98 6.95 7.18 5/281 13962
/proc/meminfo: memFree=17209100/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1584384 CPUtime=3667.75 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1769471 1251 0 0 366340 423 1 11 25 0 5 0 654716337 1622409216 369202 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 396096 369202 180 55 0 393982 0
[pid=13901/tid=13908] ppid=13899 vsize=1584384 CPUtime=931.37 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 461286 1251 0 0 93050 75 1 11 25 0 5 0 654717387 1622409216 369202 33554432000 4194304 4417452 140733447803664 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1584384 CPUtime=905.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 446826 1251 0 0 90503 68 1 11 25 0 5 0 654717387 1622409216 369202 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1584384 CPUtime=920.52 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 445297 1251 0 0 91955 85 1 11 25 0 5 0 654717387 1622409216 369202 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1584384 CPUtime=900.16 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 180180 1251 0 0 89850 154 1 11 25 0 5 0 654717387 1622409216 369202 33554432000 4194304 4417452 140733447803664 18446744073709551615 4353598 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3667.75
Current children cumulated vsize (KiB) 1584384

[startup+1002.3 s]
/proc/loadavg: 4.43 6.43 6.99 5/281 13964
/proc/meminfo: memFree=17136548/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1657540 CPUtime=3907.18 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1798920 1251 0 0 390280 426 1 11 25 0 5 0 654716337 1697320960 387491 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 414385 387491 180 55 0 412271 0
[pid=13901/tid=13908] ppid=13899 vsize=1657540 CPUtime=991.36 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 461286 1251 0 0 99049 75 1 11 25 0 5 0 654717387 1697320960 387491 33554432000 4194304 4417452 140733447803664 18446744073709551615 4346361 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1657540 CPUtime=965.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 452563 1251 0 0 96502 69 1 11 25 0 5 0 654717387 1697320960 387491 33554432000 4194304 4417452 140733447803664 18446744073709551615 4254468 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1657540 CPUtime=979.97 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 445297 1251 0 0 97900 85 1 11 25 0 5 0 654717387 1697320960 387491 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1657540 CPUtime=960.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 203892 1251 0 0 95848 157 1 11 25 0 5 0 654717387 1697320960 387491 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3907.18
Current children cumulated vsize (KiB) 1657540

[startup+1062.3 s]
/proc/loadavg: 4.22 6.00 6.80 5/281 13965
/proc/meminfo: memFree=16986380/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1808328 CPUtime=4146.65 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1836684 1251 0 0 414223 430 1 11 25 0 5 0 654716337 1851727872 425188 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 452082 425188 180 55 0 449968 0
[pid=13901/tid=13908] ppid=13899 vsize=1808328 CPUtime=1051.35 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 467039 1251 0 0 105048 75 1 11 25 0 5 0 654717387 1851727872 425188 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1808328 CPUtime=1025.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 452563 1251 0 0 102502 69 1 11 25 0 5 0 654717387 1851727872 425188 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1808328 CPUtime=1039.43 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 445471 1251 0 0 103846 85 1 11 25 0 5 0 654717387 1851727872 425188 33554432000 4194304 4417452 140733447803664 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1808328 CPUtime=1020.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 235729 1251 0 0 101845 160 1 11 25 0 5 0 654717387 1851727872 425188 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4146.65
Current children cumulated vsize (KiB) 1808328

[startup+1122.3 s]
/proc/loadavg: 4.14 5.65 6.63 5/281 13967
/proc/meminfo: memFree=16922388/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1871856 CPUtime=4386.1 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1885467 1251 0 0 438159 439 1 11 25 0 5 0 654716337 1916780544 441070 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 467964 441070 180 55 0 465850 0
[pid=13901/tid=13908] ppid=13899 vsize=1871856 CPUtime=1111.35 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 467252 1251 0 0 111048 75 1 11 25 0 5 0 654717387 1916780544 441070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1871856 CPUtime=1085.83 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 452779 1251 0 0 108502 69 1 11 25 0 5 0 654717387 1916780544 441070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1871856 CPUtime=1098.88 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 478241 1251 0 0 109786 90 1 11 25 0 5 0 654717387 1916780544 441070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1871856 CPUtime=1080.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 251313 1251 0 0 107841 164 1 11 25 0 5 0 654717387 1916780544 441070 33554432000 4194304 4417452 140733447803664 18446744073709551615 4365155 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4386.1
Current children cumulated vsize (KiB) 1871856

[startup+1182.3 s]
/proc/loadavg: 4.11 5.36 6.47 5/281 13968
/proc/meminfo: memFree=16883188/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1885448 CPUtime=4625.56 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1960919 1251 0 0 462091 453 1 11 25 0 5 0 654716337 1930698752 444468 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 471362 444468 180 55 0 469248 0
[pid=13901/tid=13908] ppid=13899 vsize=1885448 CPUtime=1171.36 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 500022 1251 0 0 117042 82 1 11 25 0 5 0 654717387 1930698752 444468 33554432000 4194304 4417452 140733447803664 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1885448 CPUtime=1145.84 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 485549 1251 0 0 114497 75 1 11 25 0 5 0 654717387 1930698752 444468 33554432000 4194304 4417452 140733447803664 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1885448 CPUtime=1158.34 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 478241 1251 0 0 115732 90 1 11 25 0 5 0 654717387 1930698752 444468 33554432000 4194304 4417452 140733447803664 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1885448 CPUtime=1140.17 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 261225 1251 0 0 113840 165 1 11 25 0 5 0 654717387 1930698752 444468 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4625.56
Current children cumulated vsize (KiB) 1885448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1226.1 s]
/proc/loadavg: 4.05 5.17 6.35 5/281 13973
/proc/meminfo: memFree=17213820/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1579844 CPUtime=4800.37 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1977493 1251 0 0 479568 457 1 11 25 0 5 0 654716337 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 394961 368067 180 55 0 392847 0
[pid=13901/tid=13908] ppid=13899 vsize=1579844 CPUtime=1215.16 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 500022 1251 0 0 121422 82 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1579844 CPUtime=1189.65 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 485549 1251 0 0 118878 75 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1579844 CPUtime=1201.74 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 478241 1251 0 0 120072 90 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1579844 CPUtime=1183.98 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 277799 1251 0 0 118217 169 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4281926 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 1579844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1226.1 s]
/proc/loadavg: 4.05 5.17 6.35 5/281 13973
/proc/meminfo: memFree=17213820/32951132 swapFree=67093824/67111528
[pid=13901] ppid=13899 vsize=1579844 CPUtime=4800.37 cores=1,3,5,7
/proc/13901/stat : 13901 (plingeling) S 13899 13901 6618 0 -1 4202496 1977493 1251 0 0 479568 457 1 11 25 0 5 0 654716337 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/13901/statm: 394961 368067 180 55 0 392847 0
[pid=13901/tid=13908] ppid=13899 vsize=1579844 CPUtime=1215.16 cores=1,3,5,7
/proc/13901/task/13908/stat : 13908 (plingeling) R 13899 13901 6618 0 -1 4202560 500022 1251 0 0 121422 82 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=13901/tid=13909] ppid=13899 vsize=1579844 CPUtime=1189.65 cores=1,3,5,7
/proc/13901/task/13909/stat : 13909 (plingeling) R 13899 13901 6618 0 -1 4202560 485549 1251 0 0 118878 75 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=13901/tid=13910] ppid=13899 vsize=1579844 CPUtime=1201.74 cores=1,3,5,7
/proc/13901/task/13910/stat : 13910 (plingeling) R 13899 13901 6618 0 -1 4202560 478241 1251 0 0 120072 90 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13901/tid=13911] ppid=13899 vsize=1579844 CPUtime=1183.98 cores=1,3,5,7
/proc/13901/task/13911/stat : 13911 (plingeling) R 13899 13901 6618 0 -1 4202560 277799 1251 0 0 118217 169 1 11 25 0 5 0 654717387 1617760256 368067 33554432000 4194304 4417452 140733447803664 18446744073709551615 4281926 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 1579844

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1226.17
CPU time (s): 4800.48
CPU user time (s): 4795.73
CPU system time (s): 4.74628
CPU usage (%): 391.501
Max. virtual memory (cumulated for all children) (KiB): 1935700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.73
system time used= 4.74628
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1978744
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 72
involuntary context switches= 25389

runsolver used 3.04454 second user time and 8.25075 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-15 05:46:01
IDJOB=3371428
IDBENCH=85008
IDSOLVER=1848
FILE ID=node131/3371428-1305431150
RUNJOBID= node131-1305431149-13872
PBS_JOBID= 13324598
Free space on /tmp= 73428 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371428-1305431150/watcher-3371428-1305431150 -o /tmp/evaluation-result-3371428-1305431150/solver-3371428-1305431150 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371428-1305431150.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9a43349587a435e7109b46b3aceb156e
RANDOM SEED=2110819838

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18158080 kB
Buffers:        280788 kB
Cached:        4081892 kB
SwapCached:       1504 kB
Active:       11338536 kB
Inactive:      3185388 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18158080 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:          290376 kB
Writeback:           0 kB
AnonPages:    10159256 kB
Mapped:          27120 kB
Slab:           175140 kB
PageTables:      32012 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 28498864 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73500 MiB
End job on node131 at 2011-05-15 06:06:35